cancel
Showing results for 
Search instead for 
Did you mean: 

raw weblogs

N/A

raw weblogs

I am using a package called Smarter Stats to analyse my log files. For the log files of a different site, it works extremely well. For my PlusNet hosted webspace, however, it reports an exceptionally high number of bad rows in the log file every day.

I was thinking, perhaps I have made a mistake in the setup but I could not really find any information in the help pages.

Question: what is the log format of the raw log files? I have a choice of:
IIS - W3Cex
IIS - Microsoft IIS
IIS - NCSA Common (this is the setting I am using at the moment)
Apache - Common
Apache - NCSA Extended
IPLanet - Common
Other - Common

Thanks for any help you can give me.

Wolf
9 REPLIES
Community Veteran
Posts: 14,469
Registered: 30-07-2007

raw weblogs

Does it give any examples of what the logfile looks like for each of the options?

I suspect it is getting confused because PlusNet are not using the standard Apache log format but one that ncludes the virtual host name.



This may help you work it out - from awstats config file I use:

# Enter here your log format (Must match your web server config. See setup

# instructions in documentation know how to configure your web server to have
# the required log format).
# Possible values: 1,2,3,4,5 or "your_own_personalized_log_format"
# 1 - Apache or Lotus Notes/Domino native combined log format (NCSA combined/XLF/ELF log format)
# 2 - Old IIS log format (IIS W3C log format). See FAQ for IIS 6.x.
# 3 - Webstar native log format.
# 4 - Apache or Squid native common log format (NCSA common/CLF log format)
# With LogFormat=4, some features (browsers, os, keywords...) can't work.
# "your_own_personalized_log_format" = If your log is ftp, mail or other format,
# you must use following keys to define the log format string (See FAQ
# for ftp, mail or exotic web log format examples):
# %host Host client name or IP address
# %lognamequot Authenticated login/user with format: "alex"
# %logname Authenticated login/user with format: alex
# %time1 Date and time with format: [dd/mmm/yyyy:hh:mm:ss +0000] or [dd/mmm/yyyy:hh:mm:ss]
# %time2 Date and time with format: yyyy-mm-dd hh:mm:ss
# %time3 Date and time with format: Mon dd hh:mm:ss
# %methodurl Method and URL with format: "GET /index.html HTTP/x.x"
# %methodurlnoprot Method and URL with format: "GET /index.html"
# %method Method with format: GET
# %url URL only with format: /index.html
# %query Query string (used by URLWithQuery option)
# %code Return code status (with format for web log: 999)
# %bytesd Size of document in bytes
# %refererquot Referer page with format: "http://from.com/from.htm"
# %referer Referer page with format: http://from.com/from.htm
# %uaquot User agent with format: "Mozilla/4.0 (compatible, ...)"
# %ua User agent with format: Mozilla/4.0_(compatible...)
# %gzipin mod_gzip compression input bytes: In:XXX
# %gzipout mod_gzip compression output bytes & ratio: Out:YYY:ZZpct.
# %gzipratio mod_gzip compression ratio: ZZpct.
# %deflateratio mod_deflate compression ratio with format: (ZZ)
# %email EMail sender (for mail log)
# %email_r EMail receiver (for mail log)
# %virtualname Web sever virtual hostname. Use this tag when same log
# contains data of several virtual web servers. AWStats
# will discard records not in SiteDomain nor HostAliases
# %cluster If log file is provided from several computers (merged by
# logresolvemerge.pl), this tag define field of cluster id.
# If your log format has some fields not included in this list, use:
# %other Means another field not used
#
# Examples for Apache combined logs (following two examples are equivalent):
# LogFormat = 1
# LogFormat = "%host %other %logname %time1 %methodurl %code %bytesd %refererquot %uaquot"
#
#LogFormat=1
LogFormat = "%host %other %logname %time1 %methodurl %code %bytesd %refererquot %uaquot %virtualname"


The last line (LogFormat) defines the actual format which is format 1 described above plus the virtualhost name added to the end.
N/A

raw weblogs

Quote
Does it give any examples of what the logfile looks like for each of the options?


Not sure that it does. I'll have a look tonight, probably will be back with more questions.

Wolf
N/A

raw weblogs

No, can't find any examples, can't find anything in the help files. Have asked the vendor for help but as it is the free version of the programme, who knows ...

I am looking into awstats, that you mentioned as an alternative.

I am receiving 2 sets of raw logs - one for URL=username and one for URL=separate domain name. Both are for the same web space.

Would you happen to know if awstats would combine both logs easily?

Wolf
Community Veteran
Posts: 14,469
Registered: 30-07-2007

raw weblogs

You should try either of the Apsche formats as that is the webserver that PlusNet use. IIS is probably not using the same file format as Apache.

Quote
I am receiving 2 sets of raw logs - one for URL=username and one for URL=separate domain name. Both are for the same web space.


If you mean you have logs for www.username.plus.com and www.domain.com both pointing to the same webspace then both log formats will be identicle.

Can you post a few example lines from your other webstats then from PlusNets so I can compare the two
N/A

raw weblogs

Yes, I do mean they are pointing to the same webspace (or at least that is what they should do), but they are not identical in size.

Logs are (luckily for this) quite small. I am not receiving much traffic yet to the site as it is still in development.

log for visualxpo.plus.com
visualxpo.plus.com - - [02/Nov/2004:00:10:16 +0000] "GET /_css/-asteye.css HTTP/1.1" 200 1718 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Q312461; .NET CLR 1.1.4322)" www.visualxpo.plus.com
visualxpo.plus.com - - [02/Nov/2004:00:10:18 +0000] "GET /mx/intro.swf HTTP/1.1" 200 67356 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Q312461; .NET CLR 1.1.4322)" www.visualxpo.plus.com
66.249.64.182 - - [02/Nov/2004:02:35:01 +0000] "GET / HTTP/1.0" 200 8467 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)" www.visualxpo.plus.com
visualxpo.plus.com - - [02/Nov/2004:02:45:29 +0000] "GET /index.htm HTTP/1.1" 404 282 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Q312461; .NET CLR 1.1.4322)" www.visualxpo.plus.com
63.238.163.76 - - [02/Nov/2004:04:36:19 +0000] "GET /index.htm HTTP/1.1" 404 282 "-" "InternetSeer.com" www.visualxpo.plus.com
4.79.40.166 - - [02/Nov/2004:07:51:01 +0000] "HEAD / HTTP/1.0" 200 0 "-" "CosmixCrawler/0.1" www.visualxpo.plus.com
pcp03879652pcs.kilng01.ct.comcast.net - - [02/Nov/2004:10:29:58 +0000] "GET /_css/-asteye.css HTTP/1.1" 200 1718 "http://www.visualxpo.plus.com/" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)" www.visualxpo.plus.com
pcp03879652pcs.kilng01.ct.comcast.net - - [02/Nov/2004:10:29:58 +0000] "GET / HTTP/1.1" 200 8467 "http://www.google.com/search?q=photography+prints&hl=en&lr=&start=50&sa=N" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)" www.visualxpo.plus.com
pcp03879652pcs.kilng01.ct.comcast.net - - [02/Nov/2004:10:29:59 +0000] "GET /mx/intro.swf HTTP/1.1" 200 67356 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)" www.visualxpo.plus.com
12-218-197-177.client.mchsi.com - - [02/Nov/2004:10:40:58 +0000] "GET /robots.txt HTTP/1.1" 304 - "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; MSIECrawler)" www.visualxpo.plus.com
65.54.188.71 - - [02/Nov/2004:10:41:28 +0000] "GET / HTTP/1.0" 200 8467 "-" "msnbot/0.3 (+http://search.msn.com/msnbot.htm)" www.visualxpo.plus.com
65.54.188.71 - - [02/Nov/2004:10:41:28 +0000] "GET /robots.txt HTTP/1.0" 200 411 "-" "msnbot/0.3 (+http://search.msn.com/msnbot.htm)" www.visualxpo.plus.com
63.238.163.76 - - [02/Nov/2004:11:14:37 +0000] "GET /index.htm HTTP/1.1" 404 282 "-" "InternetSeer.com" www.visualxpo.plus.com
mx4.cj.com - - [02/Nov/2004:14:54:34 +0000] "GET / HTTP/1.1" 200 8467 "-" "CJNetworkQuality; http://www.cj.com/networkquality" www.visualxpo.plus.com
mx4.cj.com - - [02/Nov/2004:14:54:34 +0000] "GET /robots.txt HTTP/1.1" 200 411 "-" "CJNetworkQuality; http://www.cj.com/networkquality" www.visualxpo.plus.com
66.194.6.77 - - [02/Nov/2004:16:45:10 +0000] "GET / HTTP/1.1" 200 8467 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Q312462)" www.visualxpo.plus.com
63.238.163.76 - - [02/Nov/2004:17:26:27 +0000] "GET /index.htm HTTP/1.1" 404 282 "-" "InternetSeer.com" www.visualxpo.plus.com
cacher5.ericsson.net - - [02/Nov/2004:22:00:12 +0000] "GET /_css/style2.css HTTP/1.0" 304 - "-" "Mozilla/4.0 (compatibleWink" www.visualxpo.plus.com

log for astigmaticeye.co.uk
63.238.163.79 - - [01/Nov/2004:23:54:47 +0000] "HEAD / HTTP/1.1" 200 0 "-" "InternetSeer.com" www.astigmaticeye.co.uk
S01060010dcd88f83.ok.shawcable.net - - [02/Nov/2004:00:17:02 +0000] "GET / HTTP/1.1" 200 8467 "http://www.wolfkettler.co.uk/links/photographylinks.htm" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)" www.astigmaticeye.co.uk
S01060010dcd88f83.ok.shawcable.net - - [02/Nov/2004:00:17:03 +0000] "GET /_css/-asteye.css HTTP/1.1" 200 1718 "http://www.astigmaticeye.co.uk/" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)" www.astigmaticeye.co.uk
S01060010dcd88f83.ok.shawcable.net - - [02/Nov/2004:00:17:04 +0000] "GET /mx/intro.swf HTTP/1.1" 200 67356 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)" www.astigmaticeye.co.uk
63.238.163.79 - - [02/Nov/2004:01:22:34 +0000] "HEAD / HTTP/1.1" 200 0 "-" "InternetSeer.com" www.astigmaticeye.co.uk
crawl-66-249-64-28.googlebot.com - - [02/Nov/2004:02:42:20 +0000] "GET /robots.txt HTTP/1.0" 200 411 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)" www.astigmaticeye.co.uk
crawl-66-249-64-28.googlebot.com - - [02/Nov/2004:02:42:20 +0000] "GET / HTTP/1.0" 200 8467 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)" www.astigmaticeye.co.uk
63.238.163.79 - - [02/Nov/2004:02:53:22 +0000] "HEAD / HTTP/1.1" 200 0 "-" "InternetSeer.com" www.astigmaticeye.co.uk
63.238.163.79 - - [02/Nov/2004:04:17:57 +0000] "HEAD / HTTP/1.1" 200 0 "-" "InternetSeer.com" www.astigmaticeye.co.uk
130.184.236.220 - - [02/Nov/2004:05:35:33 +0000] "GET / HTTP/1.1" 200 8467 "http://www.wolfkettler.co.uk/links/artsdesignculture.htm" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322)" www.astigmaticeye.co.uk
130.184.236.220 - - [02/Nov/2004:05:35:34 +0000] "GET /_css/-asteye.css HTTP/1.1" 200 1718 "http://www.astigmaticeye.co.uk/" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322)" www.astigmaticeye.co.uk
130.184.236.220 - - [02/Nov/2004:05:35:35 +0000] "GET /mx/intro.swf HTTP/1.1" 200 67356 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322)" www.astigmaticeye.co.uk
63.238.163.79 - - [02/Nov/2004:05:50:03 +0000] "HEAD / HTTP/1.1" 200 0 "-" "InternetSeer.com" www.astigmaticeye.co.uk
63.238.163.79 - - [02/Nov/2004:07:20:42 +0000] "HEAD / HTTP/1.1" 200 0 "-" "InternetSeer.com" www.astigmaticeye.co.uk
63.238.163.79 - - [02/Nov/2004:08:50:21 +0000] "HEAD / HTTP/1.1" 200 0 "-" "InternetSeer.com" www.astigmaticeye.co.uk
63.238.163.79 - - [02/Nov/2004:10:22:36 +0000] "HEAD / HTTP/1.1" 200 0 "-" "InternetSeer.com" www.astigmaticeye.co.uk
63.238.163.79 - - [02/Nov/2004:12:14:25 +0000] "HEAD / HTTP/1.1" 200 0 "-" "InternetSeer.com" www.astigmaticeye.co.uk
63.238.163.79 - - [02/Nov/2004:13:56:13 +0000] "HEAD / HTTP/1.1" 200 0 "-" "InternetSeer.com" www.astigmaticeye.co.uk
80.229.225.64 - - [02/Nov/2004:15:07:20 +0000] "GET / HTTP/1.1" 200 8467 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; Win 9x 4.90)" www.astigmaticeye.co.uk
80.229.225.64 - - [02/Nov/2004:15:07:20 +0000] "GET /_css/-asteye.css HTTP/1.1" 200 1718 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; Win 9x 4.90)" www.astigmaticeye.co.uk
80.229.225.64 - - [02/Nov/2004:15:07:22 +0000] "GET /mx/intro.swf HTTP/1.1" 200 67356 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; Win 9x 4.90)" www.astigmaticeye.co.uk
63.238.163.79 - - [02/Nov/2004:15:21:59 +0000] "HEAD / HTTP/1.1" 200 0 "-" "InternetSeer.com" www.astigmaticeye.co.uk
64.72.36.20 - - [02/Nov/2004:15:51:59 +0000] "GET /robots.txt HTTP/1.1" 200 411 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; rv:1.7.3) Gecko/20041001 Firefox/0.10.1" www.astigmaticeye.co.uk
64.72.36.20 - - [02/Nov/2004:15:52:00 +0000] "GET /favicon.ico HTTP/1.1" 404 285 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; rv:1.7.3) Gecko/20041001 Firefox/0.10.1" www.astigmaticeye.co.uk
CPE00e0291a50ae-CM0011aea470ea.cpe.net.cable.rogers.com - - [02/Nov/2004:16:23:09 +0000] "GET / HTTP/1.1" 200 8467 "-" "Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/125.5 (KHTML, like Gecko) Safari/125.9" www.astigmaticeye.co.uk
CPE00e0291a50ae-CM0011aea470ea.cpe.net.cable.rogers.com - - [02/Nov/2004:16:23:10 +0000] "GET /_css/-asteye.css HTTP/1.1" 200 1718 "http://www.astigmaticeye.co.uk/" "Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/125.5 (KHTML, like Gecko) Safari/125.9" www.astigmaticeye.co.uk
CPE00e0291a50ae-CM0011aea470ea.cpe.net.cable.rogers.com - - [02/Nov/2004:16:23:10 +0000] "GET /favicon.ico HTTP/1.1" 404 285 "-" "Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/125.5 (KHTML, like Gecko) Safari/125.9" www.astigmaticeye.co.uk
CPE00e0291a50ae-CM0011aea470ea.cpe.net.cable.rogers.com - - [02/Nov/2004:16:23:11 +0000] "GET /mx/intro.swf HTTP/1.1" 200 67356 "-" "Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/125.5 (KHTML, like Gecko) Safari/125.9" www.astigmaticeye.co.uk
63.238.163.79 - - [02/Nov/2004:16:49:05 +0000] "HEAD / HTTP/1.1" 200 0 "-" "InternetSeer.com" www.astigmaticeye.co.uk
CPE00e0291a50ae-CM0011aea470ea.cpe.net.cable.rogers.com - - [02/Nov/2004:16:49:58 +0000] "GET /robots.txt HTTP/1.1" 200 411 "http://www.webproworld.com/viewtopic.php?t=30162" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.3) Gecko/20040928 Firefox/0.10.1" www.astigmaticeye.co.uk
CPE00e0291a50ae-CM0011aea470ea.cpe.net.cable.rogers.com - - [02/Nov/2004:16:49:58 +0000] "GET /favicon.ico HTTP/1.1" 404 285 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.3) Gecko/20040928 Firefox/0.10.1" www.astigmaticeye.co.uk
CPE00e0291a50ae-CM0011aea470ea.cpe.net.cable.rogers.com - - [02/Nov/2004:16:50:14 +0000] "GET /favicon.ico HTTP/1.1" 404 285 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.3) Gecko/20040928 Firefox/0.10.1" www.astigmaticeye.co.uk
CPE00e0291a50ae-CM0011aea470ea.cpe.net.cable.rogers.com - - [02/Nov/2004:16:50:16 +0000] "GET /favicon.ico HTTP/1.1" 404 285 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.3) Gecko/20040928 Firefox/0.10.1" www.astigmaticeye.co.uk
CPE00e0291a50ae-CM0011aea470ea.cpe.net.cable.rogers.com - - [02/Nov/2004:16:50:32 +0000] "GET /favicon.ico HTTP/1.1" 404 285 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.3) Gecko/20040928 Firefox/0.10.1" www.astigmaticeye.co.uk
CPE00e0291a50ae-CM0011aea470ea.cpe.net.cable.rogers.com - - [02/Nov/2004:16:50:33 +0000] "GET / HTTP/1.1" 200 8467 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.3) Gecko/20040928 Firefox/0.10.1" www.astigmaticeye.co.uk
CPE00e0291a50ae-CM0011aea470ea.cpe.net.cable.rogers.com - - [02/Nov/2004:16:50:33 +0000] "GET /_css/-asteye.css HTTP/1.1" 200 1718 "http://www.astigmaticeye.co.uk/" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.3) Gecko/20040928 Firefox/0.10.1" www.astigmaticeye.co.uk
CPE00e0291a50ae-CM0011aea470ea.cpe.net.cable.rogers.com - - [02/Nov/2004:16:50:34 +0000] "GET /favicon.ico HTTP/1.1" 404 285 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.3) Gecko/20040928 Firefox/0.10.1" www.astigmaticeye.co.uk
CPE00e0291a50ae-CM0011aea470ea.cpe.net.cable.rogers.com - - [02/Nov/2004:16:50:35 +0000] "GET /mx/intro.swf HTTP/1.1" 200 67356 "http://www.astigmaticeye.co.uk/" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.3) Gecko/20040928 Firefox/0.10.1" www.astigmaticeye.co.uk
CPE00e0291a50ae-CM0011aea470ea.cpe.net.cable.rogers.com - - [02/Nov/2004:16:50:46 +0000] "GET /favicon.ico HTTP/1.1" 404 285 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.3) Gecko/20040928 Firefox/0.10.1" www.astigmaticeye.co.uk
CPE00e0291a50ae-CM0011aea470ea.cpe.net.cable.rogers.com - - [02/Nov/2004:16:50:48 +0000] "GET /favicon.ico HTTP/1.1" 404 285 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.3) Gecko/20040928 Firefox/0.10.1" www.astigmaticeye.co.uk
CPE00e0291a50ae-CM0011aea470ea.cpe.net.cable.rogers.com - - [02/Nov/2004:16:50:49 +0000] "GET /favicon.ico HTTP/1.1" 404 285 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.3) Gecko/20040928 Firefox/0.10.1" www.astigmaticeye.co.uk
CPE00e0291a50ae-CM0011aea470ea.cpe.net.cable.rogers.com - - [02/Nov/2004:16:51:25 +0000] "GET /favicon.ico HTTP/1.1" 404 285 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.3) Gecko/20040928 Firefox/0.10.1" www.astigmaticeye.co.uk
CPE00e0291a50ae-CM0011aea470ea.cpe.net.cable.rogers.com - - [02/Nov/2004:16:51:27 +0000] "GET / HTTP/1.1" 304 - "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.3) Gecko/20040928 Firefox/0.10.1" www.astigmaticeye.co.uk
CPE00e0291a50ae-CM0011aea470ea.cpe.net.cable.rogers.com - - [02/Nov/2004:16:51:28 +0000] "GET /favicon.ico HTTP/1.1" 404 285 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.3) Gecko/20040928 Firefox/0.10.1" www.astigmaticeye.co.uk
CPE00e0291a50ae-CM0011aea470ea.cpe.net.cable.rogers.com - - [02/Nov/2004:16:51:53 +0000] "GET /favicon.ico HTTP/1.1" 404 285 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.3) Gecko/20040928 Firefox/0.10.1" www.astigmaticeye.co.uk
63.238.163.79 - - [02/Nov/2004:18:12:22 +0000] "HEAD / HTTP/1.1" 200 0 "-" "InternetSeer.com" www.astigmaticeye.co.uk
63.238.163.79 - - [02/Nov/2004:19:34:20 +0000] "HEAD / HTTP/1.1" 200 0 "-" "InternetSeer.com" www.astigmaticeye.co.uk
63.238.163.79 - - [02/Nov/2004:20:55:23 +0000] "HEAD / HTTP/1.1" 200 0 "-" "InternetSeer.com" www.astigmaticeye.co.uk
63.238.163.79 - - [02/Nov/2004:22:16:40 +0000] "HEAD / HTTP/1.1" 200 0 "-" "InternetSeer.com" www.astigmaticeye.co.uk

Regards,
Wolf
Community Veteran
Posts: 14,469
Registered: 30-07-2007

raw weblogs

Your plusnet logs won't be identicle in size. Each log will only record access to the webspace via the associated domain, so if more people access your webspace using www.username.plus.com then that file will be bigger.

I was also after your non-plusnet website logs which are the ones you said you could process so I could compare them to the plusnet hosted logs.

This may help: http://www.summary.net/manual/log_formats.html

Looking at the above site, you should try Apache - Common or Apache - NCSA Extended.
N/A

raw weblogs

So that does mean that I need to combine the two logs, because visitors might come through either URL.

Weblogs for the non-plusnet website look like this:
141.156.166.223 - - [02/Nov/2004:00:03:12 +0000] "GET /1swfdat/index1.htm HTTP/1.1" 200 12287 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)"
141.156.166.223 - - [02/Nov/2004:00:03:12 +0000] "GET /_css/-pho_new.css HTTP/1.1" 200 4180 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)"
81.157.212.129 - - [02/Nov/2004:00:03:14 +0000] "GET /links/models.htm HTTP/1.1" 200 18808 "http://www.google.co.uk/search?hl=en&q=indian+models+&meta=cr%3DcountryUK%7CcountryGB" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)"
81.157.212.129 - - [02/Nov/2004:00:03:15 +0000] "GET /images/new_top_en(2).gif HTTP/1.1" 200 11482 "http://www.wolfkettler.co.uk/links/models.htm" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)"

This is only a couple of lines because the logs are huge.

For these logs, SmarterStats is set to use "IIS - NCSA Common Log Format", and it works fine.

The only difference I can see is the URL at the end of each line for the PlusNet logs, as you have already pointed out.

I have had word from the SmarterStats people, by the way, and they think the PlusNet log files won't work because SmarterStats currently does not support custom log file formats.

Wolf
Community Veteran
Posts: 14,469
Registered: 30-07-2007

raw weblogs

Yes, you will need to combine the raw logfiles and I suspect you will also need to sort them into date/time order and some webstats apps don't like out of order logfiles (i.e. you can't just process one then the other). Both a simple to do on Unix.

Have you tried to use either of the 2 Apache logfile formats?
N/A

raw weblogs

I've tried all formats, without any success.

Quote
Both a simple to do on Unix.

if you have a programming background, maybe not.

Well, at least the situation is clear now and I know I won't be able to do it.

Thanks ever so much for your help.

Wolf