Who are you?

15 December 2007

Since changing the software that I use to make this site, I broke the way Awstats shows its reports and haven't got around to reading up how to reconfigure it. So I took the opportunity to try out a stats tool provided by a major search engine.

Why you can't trust the statistics

There are three types of lies: lies, damned lies, and statistics - Rt. Hon. Lord Benjamin Disraeli

Now I have to admit I'm not the most enthusiastic stat checker. For the following reasons.

Firstly, one normally looks at statistics in order to inform one's behaviour, so you can see how the web site is fulfilling your goals and figure out how to further optimise your site for said goals, i.e. converting a web visit into some other behaviour, such as to sell something or send the reader somewhere else.

Well, this site exists just for the love of it, so I can engage with you, the readers and commentators, so we can encourage each other to take control of our own technology. The blog has never had any adverts or 'revenue streams' and probably never will. Therefore statistics are slightly academic as I have nothing to target, nothing to optimise for, nothing to flog you.

Secondly, I don't believe in basing truth statements on statistics alone. As an etymological principle, I think qualitative approaches have superiority over quantitative approaches as interpretations of figures can be extremely subjective (as we shall see below). Statistics are, at best, circumstantial evidence to test a theory that can also be justified by other means.

Awstats and the tool provided by the prominent search engine have very different methodologies but report suspiciously similar results. Awstats works on parsing my Apache logs, while the search engine uses client side Javascript (if you are curious then click on the view page source button and scroll to the very bottom). The fact that the results are so similar makes me question whether the methodologies used to collect them are too banal and mundane to tell us anything useful.

Thirdly, if there were really several thousand regular readers, why is that not being reflected in the comments? Surely you do not all passively agree with me most of the time? I'm always surprised how few of you flame me for my wackier ideas.

Fourthly, and most importantly, is the big brother aspect. We all have a right to privacy and the rare times that I bother to look at the statistics, I have an uncomfortable feeling, a bit like looking through other people's possessions.

Let's look at them anyway

Despite my apathy and cynicism for statistics, it does actually help to know who you are. I often have several choices of what to write about and have to pick just one, so knowing something about my readers might make me be more informed when choosing topics (or I might just write the same thing anyway :).

The client-side Javascript statistics are very limited as they are not tracking the syndication feeds (RSS and ATOM), which is an easy way to keep up to date of blogs, and according to my last set of Awstats reports, it is the way that at most of you keep up with my ramblings. If you still haven't joined the RSS train, then read my explanation here.

Arrivals

So if we discount those of you who read this blog via RSS feeds, and we discount those of you that follow Planet Larry or Planet Birmingham, and we ignore people with Javascript turned off and we ignore bots, then this is how the remainder of readers arrived here during the last week:

Pie chart of arrivals.

So my initial theory is that on the one hand, 'referred' readers (those that arrive via links from other sites) and 'direct traffic' (people with bookmarks or manually typing in the URL) are real people that have some kind of interest in the topic.

While on the other hand, my initial theory is that people who arrive via the search engines are basically lost. This is borne out by how long people stick around for; on average direct and referred readers will hang around for a few minutes, while on average the search engine readers leave after only 56 seconds:

'Linux', 'Python', what the heck is all this? Help, Escape, Back Button, I'm melting, Adrian, Adrian.

Operating Systems and Browsers

As you might have noticed, I use Linux and write about that and other software quite a bit. It would be useful to look at what software my readers are using as well. There was over 40 browser/operating system combinations, so I had to cut down the legends to a reasonable size.

So again ignoring the majority of you who use RSS readers, let's have a look at what operating systems the remainder of the readers are using:

Pie chart of operating systems.

Despite skewing the figures by ignoring RSS, I can't believe how many Windows users there are. This might back up the theory that a third of the people are completely lost and came here by accident. However, confidence in the 'lost theory' was undermined by the browser figures, I expected this lost third to be using Internet Explorer:

Pie chart of browsers.

So only a tenth of visitors are using IE, so either the Weasel is a lot more popular among the general population than commonly thought, or my lost theory is bogus and over-simplistic.

IceWeasel takes the web and keeps it

http://commandline.org.uk/images/posts/stats/iceweasel.png

40% are using the Weasel on Linux, 31% Weasel on Windows, and just under 20% of readers are cool dudes using some trendy web browser, the Mozilla derivatives went on and on so I cut them out.

I understand why the Weasel does better than IE on Windows, since the latter is truly terrible and basically unusable. However, it is interesting that the weasel is doing an order of magnitude better than the native browsers on Linux and the Mac. Konqueror and it's descendant Safari are really great browsers so why are people not using these faster and lighter browsers?

The two factors that come to mind are firstly that the weasel puts a lot of emphasis on brand image, and secondly the open source extension community around weasel has made it unstoppable, it is really a killer feature.

Windows and Weasel at work?

Since the lost theory wasn't panning out, I then tried reading the statistics the other way around, i.e. that visitors are not lost and really did want to come here. So in this theory, readers are not split by 'technical and meant to come here' versus 'lost and came by accident'. Instead can we understand these figures by postulating that some readers are at work, and some are at home?

So lets imagine that some readers are Linux users at home, but they have to use Windows at work where they are opening Weasel on Windows, and they know where they want to go, but instead of manually typing in the address bar, they are putting a few keywords into their search engine, having a quick peak to see what is new and then getting back to the day job. However, when at home the readers can lean back and read for as long as they like.

This of course is completely tenuous and unprovable. The only way to for me to know who you are is for you to tell me.

So who are you really?

Helpful information would include some or all of the following:

How did you get this post? Planet, RSS feed, search engine? If you were referred from somewhere, where was it?

Which out of the headline subjects do you like reading about: Linux, Command Line, Pythom, Ethics, This Week.

What operating systems/distro do you prefer to use/hear about?

What country are you from?

1 John Reese says...

I've been a regular reader via RSS (Google Reader) for a couple months, but I was originally directed here by a programming Reddit article. I use Ubuntu Linux both at home, in classes on my laptop, and at the office (PHP web app developer). I don't remember what the original article was that brought me here, but I think it had something to do with Python, which is another language I like to use.

And it's not the Ice Weasal on Windows, Mac, Ubuntu, or any other non- Debian/GNU distro, btw. ;)

Posted at 2:25 a.m. on December 15, 2007


2 Dave Caplan says...

I personally go to your website and check it via RSS. I found your website one day searching (on Google) for a command line help and have loved it ever since. I'm a big Linux fan (used to be Gentoo, now Ubuntu) and use it for my work PC. My home PC is still Windows for gaming. I'm planning on encrypting my /home partition now. ;)

Posted at 2:50 a.m. on December 15, 2007


3 Daniel says...

I mostly read via RSS using akregator. I followed a link from the Bash cures cancer blog a long time ago, stuck the RSS link in akregator, and have been a regular reader since. :-D

I've been using Linux exclusively for almost 4 years now, starting with RH 9, then slack for a couple years, and I've been using gentoo on my laptop for about 6 months now.

As a side note those pie charts don't display at all under konqueror.

Posted at 5:27 a.m. on December 15, 2007


4 Phill says...

I usually read this blog via the RSS feed (Google Reader). Incidentally, if you use FeedBurner you can get statistics on how many people are reading via the RSS feed.

I like reading about most of your headline subjects, although I tend to prefer posts which are more focussed (i.e. I don't always read all of the 'this week' posts)

I use Ubuntu Linux at home, Windows at work (because I basically have to), although we do have a few Red Hat and CentOS servers which I need to use frequently.

Oh, and I'm from the UK!

Posted at 10:21 a.m. on December 15, 2007


5 Zeth says...

Thanks everyone for coming over and letting me know about yourselves, it is really helpful. If everyone does read via RSS then the web stats are somewhat irrelevant.

@Phill, "prefer posts which are more focused" - you have been here before? Slim chance of that ;)

@John Reese, I just read your article about cubicles it made me snigger, very true. The Weasel is called by its version name on Gentoo (e.g. Gran Paradiso).

The Weazzila Corporation trying to control downstream Linux distributions through their proprietary art, name and binaries is a really dumb thing to do, it seems that Weazzila has expanded so fast on the back of the Google cash that a lot of people in that company don't really understand Open Source, and don't care about furthering Open Source beyond using Weasel on Windows.

@ Dave Caplan, encrypting /home is important, so do let us know how you get on with it.

@Daniel, akregator is very popular I think, there were a lot of akregator users in the last awstats report. I started with Slackware, but then also went to RH 9! It was my first graphical distro and I have been using GNOME ever since.

About the pictures, my Konqueror (running on GNOME) seems to render them just fine, so I'm not sure what is going on there.

Posted at 10:27 a.m. on December 15, 2007


6 Jean-Etienne says...

Hi Zeth,

I am a regular belgian reader via RSS (Google Reader) and probably came via a search about something on Python or the command line. I usually read all the subjects :-) Linux is my preferred operating system (although I'm often forced to work under Windows at work).

Posted at 2:56 p.m. on December 15, 2007


7 Daniel Andrlik says...

Hi Zeth,

I found your site via a Technorati search when you linked to an article I wrote on recording Skype with a script.

At home I use Gentoo exclusively, although my girlfriend uses Ubuntu. Sadly, my workplace is currently Windows-only. I tend to read all your posts although I most enjoy your more in-depth Linux tutorials, and your articles on using Python. In recent memory, I particularly liked your series on encrypting /home, which I intend to try out as soon as I get my laptop back from warranty service.

Posted at 4:12 p.m. on December 15, 2007


8 Leif Biberg Kristensen says...

I'm usually reading your blog in Akregator, via Planet Larry, as I'm a Gentoo fanatic. It's one of the blogs I enjoy the most. My favourite browser is SeaMonkey (formerly known as Mozilla). Konqueror may be adequate for viewing a few standards-compliant sites, but I've found that it fails miserably in so many cases that it's basically useless.

I've got a theory about the many Windows users. A lot of them may run Windows on their desktops, but like I myself did for several years, they may have a headless "server" (ie. the old desktop system) under the desk running Linux.

Cheers from Norway, Leif.

Posted at 5:58 p.m. on December 15, 2007


9 Maxime Pelletier says...

I'm in the minority of the minority =). Using opera (via rss feeds) on Gentoo for something like 2 years. I don't really remember how I discovered your blog, but I read it most of it. I wish I would blog as much as you do, but it seems i'm good at procrastination haha.

So good that I dont really bother to comment even if I have something to say... but I wanted to do it this time anyway.

Posted at 8:09 p.m. on December 15, 2007


10 Neil says...

Hey Zeth,

I got this post via Google Reader. I subscribed a while ago, after finding your blog while searching around for command line tips I think.

Linux and ethics are the two top topics for me (for example the /home safety posts and ODF vs. OOXML posts). Python and Gentoo posts the least interesting for me, but only simply because I don't use either of them :)

I use the Elive distro (which is essentially Debian with Enlightenment handily preconfigured.)

I'm from the UK.

I use Iceweasel, despite it being a bit of a resource hog -- the extensions are a killer feature for me.

Thanks for the great blog!

Cheers Neil

Posted at 8:14 p.m. on December 15, 2007


11 Bug says...

  1. Thank you for ignoring me :) Ney Google!

  2. I use Firefox [Currently unbranded because I'm too lazy to compile it

    again] because I'm on Xfce. Besides, I like the extensions.

  3. Coming via RSS :)

  4. Home is duel boot which rarely [Only recently got used more] boots

    Windows. I wub my ArchLinux.

  5. I forgot how I got here in the first place.

  6. When are you going to post the guest week?

Posted at 9:24 p.m. on December 15, 2007


12 David says...

How did you get this post? Planet, RSS feed, search engine? If you were referred from somewhere, where was it?

I have your site bookmarked and check it frequently. I found it via a Google search earlier this year, but don't remember what I was looking for. I run Gentoo at home, but most often read your posts from work on Windows/Firefox, otherwise occasionally from home on Linux/Firefox. I would agree with your idea that people are accessing your site from work on Windows boxes.

Which out of the headline subjects do you like reading about: Linux, Command Line, Pythom, Ethics, This Week.

All.

What operating systems/distro do you prefer to use/hear about?

Gentoo.

What country are you from?

Canada for the most part.

Keep up the great work.

Posted at 10:31 p.m. on December 15, 2007


13 pilpilon says...

Hi, I've your blogg aggregated on Google start page, so I think I've counted under referring sites.

Read it using Firefox or Mosilla at work, on Solaris, or Konqueror or Swiftweasel at home, on Kubuntu. I'm a big fan of Python, on CL tricks are big fun to read, too. And I'm from Israel.

Posted at 12:27 p.m. on December 16, 2007


14 Mr Stuff says...

I like to read about Linux and command-line stuff. I'm not interested in Python or Gentoo-specific stuff. Stuff

Posted at 6:46 p.m. on December 16, 2007


15 Per Thulin says...

Hello Zeth! I read your blog through Google Reader, going to your site only to post comments. Your blog is one of my favourites, cannot remember ever marked anything as read.

I don't remember how I got to know your site, from searching a think.

I'm split between Ubuntu and Fedora, using Firefox on both.

My favourite posts are those that fall under the ethics category. Maybe a post about the IceWeasel thing would be nice? As far as I can see, they don't hinder the use of their brand any more than say Canonical does with Ubuntu.

And I'm from Sweden! Currently studying, though finished soon, hoping to work on Linux related stuff. Mostly interested in computer graphics.

Posted at 7:35 p.m. on December 16, 2007


16 Erdem says...

I read your blog through firefox under wine.I got here from planet larry. I like reading about command line and linux. I prefer to hear about Gentoo. I use Gentoo at home. I am from Turkiye. I am interested in c++ programming, Emacs, E17 window manager and cartoons.

Posted at 9:24 p.m. on December 16, 2007


17 David Jones says...

How did you get this post?

On RSS feed, read in Safari on a Mac running Mac OS X. I can't remember how I first found your blog, probably something to do with PyCon 2007.

Which out of the headline subjects do you like reading about: Linux, Command Line, Python, Ethics, This Week.

Everything except This Week. I find the the odd foray into history/religion/art/humanities all the more illuminating.

What country are you from?

The UK.

Posted at 11:46 a.m. on December 17, 2007


18 DC says...

i read it via rss in outlook 2007 i read all of it, i am in the UK and using windows XP (at work) and a mix of XP, Fedora 8 and vista at home

Posted at 12:37 p.m. on December 17, 2007


19 Simon Hawkins says...

I have the site bookmarked using Portable Firefox at work which as normal is a Windoze environment.

At home the 'family' PC is Windoze where I have my own copy of Firefox installed, though my laptop is exclusively Xubuntu now, partly because I mashed the Win ME partition so I'm now going to encrypt it and set it as a home partition when I manage to get so free time, which will probably be Jan.

I came here through a link on another site, possibly Bash Cures Cancer, about 9 months ago.

Posted at 1:22 p.m. on December 17, 2007


20 Albert says...

Albert representing from New England. I primarily browse with Camino, no RSS, sometimes elinks. Regular reader of your blog. I keep wanting to answer your human test with wombats though. Maybe you could make it something lamer like windows, then I'd always want to answer warriors.

Posted at 4:12 p.m. on December 19, 2007


21 Ian Gregory says...

How did I get here?

This is my first visit to your site but I'll be back:-)

I found your "Steal This Wi-Fi" post referred to on the "Truth Happens" RSS feed at redhatmagazine.com which I have been subscribed to for a while.

I work from home, using an Intel iMac running Mac OS X Tiger, which is essentially the only machine I ever sit at (but I do use a shell account on a remote Debian box at mythic-beasts.com).

I use Safari for all my browsing and NetNewsWire for all my feed reading.

I just subscribed to your feed and bookmarked your site on del.icio.us

Posted at 2:32 a.m. on January 11, 2008


What do you have to say?

Show Editing Help


About

Hello, my name is Zeth, I'll be your host here.

Command Line Warriors is about taking control of your own technology, it looks at our experiences of computing; especially using GNU/Linux, the Python programming language, the command-line and issues such as techno-ethics, best practices and whatever is cool now. If you take control of your technology then you are a Warrior too!

This site is your site too which means that you can contribute and get involved. You can leave comments using the facility provided. For me, the comments and discussions are by far the best part of the site. So please do have your say!

Latest Discussions

Omar Zabaneh

July 25, 2008
Zeth, Thank you for this post, very helpful. I used it as a basis for my own email validation function that i wish to share with you, in a selfish ...
Email Syntax Check in Python

Double Booting Bastard

July 24, 2008
I agree with Nui, Linux is great for many things but not everything. A lot of, less mainstream, hardware is a time consuming and often fruitless task to install and ...
Give Linux a chance

John

July 23, 2008
Duncan, sadly the permissions are stored with the data (inode), not with the directory entries (hard-links). Zeth needs ACLs -- no way to do this with basic unix permissions.
Advanced Unix Groups

Garrick

July 21, 2008
I do love my iPhone. That being said, I would trade it in a heartbeat for a STABLE Openmoko FreeRunner.
This week - iPhone vs a can of compressed air, and Django NewFormsAdmin

Daniel Davies

July 21, 2008
With regards to your last paragraph, you are certainly correct. Right now Django is a nightmare to use across multiple sites... we have some sites running the newformsadmin branch, others ...
This week - iPhone vs a can of compressed air, and Django NewFormsAdmin

Nui

July 18, 2008
Hmm, this would be more persuasive as an argument with some evidence. I am a happy admin of Windows and a novice user of Linux, so I have taken the ...
Give Linux a chance

Paddy3118

July 18, 2008
Hi, I too work with Electronic Design Automation tools, where Tcl is used extensively. I tend to only occasionally have to write in Tcl and so find the TclTutor utility: ...
Python and TCL

Cliff Wells

July 17, 2008
I personally cannot live without the Web Developer extension or Firebug. Unfortunately these are probably both among the more difficult to port extensions. Given how poorly Firefox functions on Linux ...
Will Epiphany be able to compete with Firefox's extensions?

Åke Forslund

July 13, 2008
I'm pretty much a novice in both of these languages but I find them both easy to use and preform the tasks I give them. However I rarely use them ...
Python and TCL

Christopher Thoday

July 12, 2008
A single test is not sufficient to give you confidence that the algorithm is working. You should make 'number' an argument of 'main' so that you can test some boundary ...
Python and TCL

paul21

July 10, 2008
Shame on Mozilla. They should make developers specify the extension license before hosting it. They should show the license next to download button as well.
Are your Firefox extensions proprietary software?

Tris

July 8, 2008
Justin - You say they had not heard of Linux? That doesn't sound very professional to me!
Give Linux a chance

michael

July 8, 2008
what about Galeon? in Gnome i use Galeon mostly. it is fast and stable and has a nice portal with search masks for Debian, FSF, Freshmeat and so on. wtf ...
Will Epiphany be able to compete with Firefox's extensions?

vermin

July 7, 2008
> Eventually, after a bit of digging and Googling, I found their Toolbar-License... You simply found the license of the StumbleUpon Toolbar for Internet Explorer. This is another product, much ...
Are your Firefox extensions proprietary software?

Andrew West

July 6, 2008
Both the Python and the Tcl example could do with error checking. While at first this may not seem on topic with the post I think it better shows the ...
Python and TCL