Ho John Lee's Weblog

These are my links for June 1st through June 2nd:

• jqPlot – Pure Javascript Plotting – jqPlot is a plotting plugin for the jQuery Javascript framework. jqPlot produces beautiful line and bar charts with many features including: Numerous chart style options. Date axes with customizable formatting. Rotated axis text. Automatic trend line computation. Tooltips and data point highlighting. Sensible defaults for ease of use.
• New Twitter Research: Men Follow Men and Nobody Tweets – Conversation Starter – HarvardBusiness.org – "Although men and women follow a similar number of Twitter users, men have 15% more followers than women. Men also have more reciprocated relationships, in which two users follow each other. This "follower split" suggests that women are driven less by followers than men, or have more stringent thresholds for reciprocating relationships. This is intriguing, especially given that females hold a slight majority on Twitter: we found that men comprise 45% of Twitter users, while women represent 55%."
• Shirky: Power Laws, Weblogs, and Inequality – 2003 article on popularity / traffic on blogs, which was then the latest emerging social media format. "Once a power law distribution exists, it can take on a certain amount of homeostasis, the tendency of a system to retain its form even against external pressures. Is the weblog world such a system? Are there people who are as talented or deserving as the current stars, but who are not getting anything like the traffic? Doubtless. Will this problem get worse in the future? Yes. "
• well-formed.eigenfactor.org : Visualizing information flow in science – Some nice visualization ideas using hierarchical clustering to explore patterns in citation networks.
• Bing API, Version 2.0 – Updated API documentation for Microsoft Bing (formerly Live Search) web services.

These are my links for May 29th from 05:17 to 12:45:

• Some stats from Twitter conference compared to… – Robert Scoble – FriendFeed – Anecdotal data from 140tc this week. 200 tweets/second at peak. Didn't see an estimate of current user account population though, I keep seeing site unique visitor estimates, which aren't useful.
• Microsoft Silverlight vs Google Wave: Why Karma Matters | Zoho Blogs – "The real interesting contrast to us, as independent software developers, is the way developers responded to Silverlight as opposed to the reaction yesterday to Google Wave. Both Silverlight and Wave are aimed at taking the internet experience to the next level. To be perfectly honest, Silverlight is a great piece of technology. Google Wave, as yet, is not much more than a concept and an announcement. It is easy to dismiss all this with "Oh, the press just loves to hype everything Google, and loves to hate Microsoft," but that cannot explain why even competitors like us are willing to embrace Google's innovations, but stay away from perfectly good innovations from Microsoft, such as Silverlight? It comes down to one word: karma."
• makerfaire.com: Maker Faire – This weekend at San Mateo Expo Center
• Google Wave Federation Protocol‎ –
• Google Wave API Overview – Google Wave API – Google Code – APIs for Google Wave email / bbs / wiki / chat / collaboration / communications mashup platform introduced yesterday.
• What Emacs Commands Do You Use Most and Find Most Useful? : programming – Reddit thread discussing favorite emacs commands

These are my links for May 22nd from 06:31 to 07:14:

• Javascript Malware Analysis: A Case Study – "This particular beast was found in the wild in May 2009 on a site phishing for Facebook user credentials, and is a particularly-nasty bugger. Note the number of strangely-named variables created up front, many of which are not even referenced in the code blocks that follow. Additionally notice the odd ternary statements which have no impact on the operation of the code, and presumably must exist to trip up scanners (unless there is a fancy form of string replacement on the body of some functions, in which case the functions could be mutated before execution – and that would be scary. A cipher based on the body of the function has also been seen.)"
• MySQL: Forked beyond repair? | Developer World – InfoWorld – Now that MySQL is part of Oracle, will the forks take over? "if MySQL's approval ratings are slumping, all the more reason for Oracle to move decisively. Oracle must work to regain the trust and support of the MySQL community or risk losing mindshare to a fork, such as Drizzle or MariaDB. To do that, it has to avoid making the mistakes that Sun made when it acquired MySQL. In a sense, to succeed with MySQL, Oracle will have to stop acting like Oracle."
• Scott Hanselman’s Computer Zen – Less Virtual, More Machine – Windows 7 and the magic of Boot to VHD – Notes on using Windows virtual hard drives to manage instances of multiple version of Windows in parallel, e.g. Windows 7 beta, WinXP, etc.
• How Opera’s business model works – Communication Breakdown – David Meyer’s Blog at ZDNet.co.uk Community – Around 40M users, "Most of our revenue — 75-80 percent — comes from mobile devices, fom a free browser. We provide the browser for free, like Opera desktop and Mini, and then we generate revenue through our content partners. We provide the search in the right corner and things like that, and that generates revenues in the free distributions. Then you get paid by OEMs [original equipment manufacturers] for distribution — companies like Nokia and Motorola. Most of the mobile OEMs and a fair amount of the other OEMs. We signed up Ford recently and we're now in Ford trucks."
• Digicorp » Blog Archive » Prevention of Sql Injection with PHP – Notes on good coding hygiene for avoiding SQL injection attacks while processing web form input such as passwords and other text fields.

These are my links for April 20th through April 23rd:

• What I’ve Learned from Hacker News – Paul Graham on social dynamics and managing Hacker News, user submitted comments and ranking (voting up/down) , editorial intervention and moderators, project goals.
• SEOmoz | Reddit, Stumbleupon, Del.icio.us and Hacker News Algorithms Exposed! – Looking at variations on algorithms for ranking items on social news aggregators
• NGINX + PHP-FPM + APC = Awesome – Walkthrough on setting up cached PHP web server on nginx with apc.
• Particletree » PHP Quick Profiler – Lightweight tool for profiling PHP code.
• MySQL’s Full-Text Formulas – Database Journal –
• http://www.acapela-group.com/text-to-speech-interactive-demo.html – Online text-to-speech demo, with various male and female speakers, plus a few translations.
• Dealing with Duplicate Person Data – Proud to Use Perl – Classifying likely duplicate entries in name/address contact data using Levenshtein distance and tables of nickname synonym and assigned distance weights.
• Web Security Horror Stories: The Director’s Cut at <head> – Presentation slides from a talk by Simon Willison on cross site scripting, SQL injection, referer forgery, and clickjacking attacks on web applications.

I’ve had two online forum transition experiences in a week now. It’s interesting to observe how quickly an existing user base can be fragmented or even lost altogether.

The Yahoo Finance message boards uproar continues. Now that I’ve tried it more than once during the past few days, I’m still finding it difficult to scan quickly. More importantly to Yahoo, there are signs of mass migration to other message boards by very active participants looking for a new home. Much of the flock may still settle back at Yahoo, but it looks like there’s been a lot of people checking out the alternatives during the past few days.

On a completely different front, I have been part of a running forum which has been at Runners World magazine. I usually check in once a week or so, and participate in a weekly motivational game in which teams of runners post their weekly mileage. A few weeks ago, Runners World changed their forum software. In the process, the site went completely offline for a while, and later required re-registration by existing members. Their new message board there isn’t as much of a change as the Yahoo boards, but the extended outage appears to have dispersed many of the participants to other message boards. I only check once a week, and haven’t succeeded in re-registering my account yet, so I effectively disappeared. A few people from the Marathons forum eventually tracked me down today and pointed me at an “escapee” forum set up during the interim, which seems to have picked up many regulars in just a few weeks.

Assuming that either Yahoo Finance or Runners World finds it constructive to run an online message board, it’s interesting that there has been very little (no?) dialogue that I know of between the operators of the sites and their respective user communities. I suspect that a few bread crumbs of communication would have kept more people on board.

Dropped by the Yahoo Finance message boards this evening to scan through comments. The Yahoo Message Boards have been around in the same form for nearly as long as Yahoo, and for the past several weeks Yahoo has been testing a new format, which I find hard to read. Fortunately, there was a link to return to the original version, and I think it’s been popular.

Sometime over the weekend, all Yahoo Finance message boards have been upgraded to the new version, with no way to get to the old version.

This post captures the sentiment of many members:

IMPORTANT MESSAGE FROM YAHOO!
Hi, I am the Project Manager for the new Yahoo Message Boards. I just wanted to let you all know that we will be adding even more new features to the stunning new boards next week:

1) Starting next Monday, all new posts will automatically be translated into Norwegian. Our Yahoo Finance development team decided that users would want this, and since we do not speak directly to users before updating our site, we will assume this is a highly desired feature. The brilliant Stanford Ph.D.’s we hired to update the site thought it would be cool! Due to disk storage issues, we regret that we will no longer be able to offer your posts in English. Please learn Norwegian, and let us know how it goes on our Feedback form! We read every form you send us!

2) As you know, we recently stopped listing stock board posts chronologically, and went to a thread-based system. We feel that stock investors do not need to clearly see the latest posts in chronological order, during the trading day, and our Ph.D. geniuses from Stanford think you would prefer to dig through threads to find old posts on your stocks. More importantly, later this month, we will be removing the dates and times from all posts, and then in September we plan to mix them all up randomly. We hope that you are not inconvenienced by reading 8 year old posts when making investment decisions. Please use the helpful Feedback form to let us know what you think. We read every one!

3) As you may know, in the Beta we switched from a simple and effective system of “recommending” posts with a click, to a more complex one in which you rate posts with stars. Of course, you can only see the number of stars for the first post in a thread, but we feel this is better even if no one ever uses it. Our Ph.D. developers informed us that “complex” equals “better”. So next month, we will replace the star system with a new even more complex one, in which you will manually calculate the cube root of how much you like the post on a scale of 3.4 to 11, and then divide by pi. Please let us know what you think on the Feedback form, which next month will only accept entries in Hexadecimal. We read every post.

Finally, just to get you excited and build some anticipation, I wanted to let you know that our Ph.D.’s are working on a new feature for 2007. Posts will be automatically scanned for keywords by our cool super-complex search technology, to determine if they would be better suited to a different stock board, and if so, they will be automatically moved. We feel the slight inconvenience of having posts moved around by the system will be outweighed by how cool the technology is!

Regards,
Yahoo Finance Development Team Manager ”

The new version defaults to thread-oriented, has a 5-star rating system, and provides a filter to view only highly rated posts, similar to Slashdot. This seems like it could be helpful to people who want to see popular topics. Unfortunately, the new message board format makes it very difficult to view posts in time sequence. It also doesn’t have the old message numbers, so people who kept lists of “useful” posts are out of luck, and in general seems to make it difficult to get to older posts except through search.

There are typically many more readers/lurkers than writer/posters on any message board. The board revisions seem geared toward helping the occasional reader, but also seem unpopular with the current board communities who actually generate the content. There’s a lot of grumbling, and at least some early signs of migration to other boards, such as Investors Hub, Raging Bull, Silicon Investor, and Investor Village.

After some experimenting, I’ve found it a little easier to use after changing the view preferences to “expanded” and “message list”. I suspect the threaded format may eventually help separate traffic between the buy-and-hold crowd and the short term traders, if people stick with the new system. In the meantime, there appears to be a surge of people trying out the other services.

It will be interesting to see how the transition works out. I find the new format more difficult to read, and it seems to be unpopular among the existing communities. On the other hand the new message boards format may be easier for new people to participate, and could grow new communities to replace the existing ones.

There’s some speculation on Yahoo’s intent, this post is representative:

It’s puzzling that yahoo would enforce this new system when there’s been clear evidence (from neglect of the trial format in the last weeks) that it’s not popular. I suspect there is a familiar style of coercive industrial ad mgt driving things. If you use the new format, you are coaxed/forced into playing a sort of teenage interactive popularity contest, like voting for pop stars. I assume this is to persuade advertisers that the system gooses up user enthusiasm. The problem is, as in consumer mkting, the “threads” preselect what you can see and respond to, channeling your attn the way news reporting and ads preselect the reality you can see. In effect, yahoo is part of a larger industrial paradigm in which life is a consumer decision-tree rather than a play of curiosity and discussion / analysis. Part of the frustration being felt is that you know you’re a mouse in a maze. You’re being trapped inside a teenie bopper fan magazine rating “products” rather than sharing ideas. It’s a shame to see such a useful forum crippled by childish advertising trickery.

I’m less cynical about the intent of moving to a threaded view, but it’s clearly an uncomfortable change for many participants who are more engaged there than myself. The challenge for Yahoo is that much of the value in the Finance boards is that there’s enough traffic and/or useful posts on many of them (AAPL, GOOG, TIE, most highly traded stocks) to make it worth checking out from time to time, but the interests of the active board community are different than those of a casual viewer, and for the moment there’s a disconnect in progress. Yahoo may have also picked an inopportune weekend to switch over, since posting volume is likely to be high during the next few days, reacting to events in the Middle East.

I was recently pointed at Instant Bull, a new site intended to scan multiple finance boards. Unfortunately it wants Firefox 1.5, and I’m still running 1.x for now, so I’ll have to check it out later.

Update 07-16-2006 23:00PDT: More from PaidContent, GigaOm, CNet

Update 07-18-2006 19:45PDT: There’s an impressive level of antipathy toward the new message board format. Yahoo Finance members have rapidly started setting up beachheads on other sites. One anecdote from the YHOO board:

ELN on Investor Village shows that over 800 members and over 1800 guests (probably folks checking out alternative boards) have visited in the last 24 hours! Who even heard of Investor Village before this week?

I did a search of messages on Yahoo’s ELN board and saw that there were almost 500 postings between 6AM yesterday and 6AM today (for some reason, Yahoo’s search function is not showing any results for postings after 6AM today), most of which were probably related to complaints about the new format. Then I did a search on the number of postings done since 6AM today on the ELN board on Investor Village and there’s been over 400 posts! Considering they only have 1805 posts in total on the board and considering the number of people that have visited the ELN board on Investor Village in the last 24 hours, it tells me if Yahoo doesn’t find a way to bring back something similar to the old format and the complainers on Yahoo see that their complaints are getting them nowhere, there’s gonna be a mass exodus of all these people that are now posting on or at least checking out Investor Village.

This ‘upgrade’ implementaion has been a disaster. Competitors like Investor Village are taking advantage. Even if Yahoo gains some of their traffic back, they won’t recover all of it just like Coke didn’t gain all of their market share after the New Coke fiasco. If this an indication of Yahoo’s current business model, do you really want to be an investor in this stock as future ‘upgrades’ are implemented????

Vestiges of the “old” system are still around in the non-Finance sections of Yahoo, so others have been trying to set up shop there, such as this alternative AAPL board. I suspect these may not last for long.

Tom Foremski has commented on the uproar about the new message board format in the context of user interface design: “people are creatures of habit and nobody wants to have to learn a new user interface”. I agree, but I think there’s more to it than people not wanting to change. I personally find the new format difficult to visually scan, and in retrospect I see that I tend to watch for interaction among certain individual contributors, as well as for general noise level around various topics. The new system would probably work well for topically driven forums, while many of the high volume forums border on IRC chat.

Message boards are pre-Web 1.0 social software, dating back to the days of dialup BBSes. One view might be that the users just don’t “get” the Web 2.0 fit and finish being wrapped around Yahoo Finance. However, I think the clash here has mostly been about a mismatch between the existing community of users and the use of the site as envisioned by the Yahoo Finance product management team.

I conclude that there’s either a serious gap in how the user testing and feedback process worked, or there’s been a conscious management decision to change the character of the Finance Boards product, to clean up the content and make it better behaved by making it less interactive. Historically, many of the posts are of questionable merit, laced with profanity, innuendo, misrepresentation, and other disinformation. However…if you knew that already, then the flow of the pumper/basher posts itself was a useful data point, along with posts from individual traders and investors offering up independent opinions. Looks like that’s another bit of history now.

YHOO shares dropped hard in after hours trading today, the latest earnings matched, but search monetization isn’t growing well. Ironically, it sounds like at least a few traders shorted YHOO at the close, out of a combination of spite and a sense of management distrust following the message board fiasco. Not a sound rationale for the trade, but it clearly worked out for them.

Update 07-20-2006 14:36PDT – Yahoo has added a link to the old message list view, labeled “view all messages”, next to “view all topics”. The individual posts are still formatted in the “new look” though.

I’m really curious about what effect this is having on traffic and monetization at Yahoo Finance. I recognize a number of user handles that have moved to Investor Village or Investors Hub, and there are daily notices there from the site operators on server upgrades and other steps to accomodate the unexpected boost in traffic.

Some of you may also be interested in checking out SaneBull, an example of an AJAX-based stock info scanner. via TechCrunch