Progress on Gargoyle

Remember Gargoyle? Well, it hasn't been abandoned yet. I've been rewriting the design and scrapping it over and over. I think I've finally reached a design that's stable, and that will plug nicely into all kinds of stuff. Today I wrote a lightweight web.py-based POI system. It gives a user a random hash which is used to identify a unique POI list. Access is done RESTfully. That is:
http://www.example.com/locate/te6hemi8t3cu/38.89768/-77.036455/
Which would display all POIs in the list te6hemi8t3cu that are in the box bounded by (38.897000, -77.036000) and (38.897999, -77.036999). That is, three spaces after the decimal is my chosen granularity (it's roughly walking distance). The POI list is produced either in a human readable bullet-point list (for easy display on mobile devices), or as a KML file (with some added metadata of course. Such as an expiration date for the entry). Adding a POI is just as easy, just using add instead of locate, and appending /poi_info to the URL. This means that you can easily write apps to use this simple API, as well as display it using Google Earth. What's the next step? I need to convert my already existing client for the Nokia N800 to be able to use this POI list, as well as maintain its own POI cache. It should only read to the user things within a 4 or 5 decimal space distance, and not bother querying unless the user is approaching the edges of the grid box she's in. Finally, once these infrastructure issues are taken care of, the real purpose of Gargoyle will be implemented. This takes the form of a the app that goes through your "reading list" and adds relevant items to the POI list. I will post the code for the N800 code and the POI server some time within the week. It still needs some cleanup. Gargoyle v0.2 here we come! Addendum: POIs can also be meta-POIs. That is, rather than being a placename, an entry into the db can be a uri to an external kml source (can be dynamic). An example would be a URL that points to a script that forwards the coords to the Geonames Wikipedia web service service (shows nearest wikipedia entries) and converts the resulting XMl or JSON into KML.

Making a Terrorist

There are many myths about terrorists and their origins, motivators, goals and methods. There are many pundits who express their various opinions and conjectures. But there are relatively few works that present more studied information. Here are two books that I own, which provide a wealth of information. Each of these tomes completes the other: The first of these, with a rather odacious title, is based on a lecture series given by its author, a respected economist. It is a fairly slim paperback overflowing with data. There are tables filled with meaningful figures nearly every other page. This work is an attempt to understand the circumstances and demographics of terrorism. As one review of the book stated, it really does not answer the question posed by its title. Rather, it describes what terrorism isn't. Poor economic prospects, poor eduction, poor healthcare, all those are factors commonly presented as motivators for terrorism. Krueger's meticulous analysis shows that this is rarely the case. His investigation shows that no single religion has the lion's share of terrorists. Nevertheless, most terrorism is perpetrated by members of a religious group other than that targeted. Other factors that Krueger finds do characterize terrorists are limited political freedoms and civil liberties. Wright's Pulitzer-prize winning masterpiece follows quite a different side of terrorism. Rather than concentrating on data, it provides a non-fiction narrative following radical Islamism from its roots with Sayyid Qutb to the important-to-America Osama Bin Laden. Captivating in its detail, Wright creates an intimate profile of the men who shape much of terrorist-spawning radical Islam. The two books together construct a visceral image of one of the greatest dangers facing our world. They are illuminating, educational, and very very important.

Unified Identity Design

My online identity is highly fragmented. Some parts are public, others are restricted to specific groups. Part of my identity is presence. That is, the way people can find out what I'm doing, and contact me. Here is a taxonomy of some different aspects of my Online Identity:
  • Events: Google Calendar, Facebook Events
  • Personal Information: Facebook, LinkedIn
  • Text Messaging: AIM, SMS, GoogleTalk, Email
  • Voice: Cell, Skype
  • Contacts: Facebook, LinkedIn, Gmail contacts, Cellphone contacts
  • Presence: AIM Away message, Facebook status, Twitter
The idea of Unified Messaging is a vertical solution in that it attempts to aggregate the methods of contact for one person, but it usually does so via proprietary solutions for each category. That is, there is a provided method for events (that is, calendar), personal information, text messaging, and voice. What I want is a way to take all of my existing solutions, and create an intermediate format, which can be used to update all the rest. And then I want mobile access. I plan on integrating some of this into Gargoyle. The method of implementation will most likely be FOAF, though I'm as yet unsure about how I want to store my events. Events right now are probably the best category, since facebook publishes an iCal feed of my events, which I have imported as a dynamic calendar into my Google Calendar. The Google Calendar, in turn, sends me event notifications to my cell, via SMS. My initial task is to be available via whatever way is most convenient, no matter what the original mode of contact was, with SMS being the common-denominator. This can be most easily achieved by putting gatekeeper bots at each incoming mode of communication. So, there will be an AIM bot, that when set to "on" would forward all incoming AIM messages to an appropriate alternative location. Perhaps an even easier way would be to use existing methods: run my own Jabber server, with transports for all the various protocols. Jabber is also the easiest method for which to write bots in python. These are some preliminary ideas that I'm filing publically. More to come soon.

Transparent Society, Privacy, and the Balance of Power

Recently Bruce Schneier posted a debunking of the idea of a Transparent Society (such as put forward by David Brin). He argues that the while the more open exchange of information in society can lead to a power balance, existing power structures mean that those already powerful will benefit most from disclosure. Here's a quote near the top:
You cannot evaluate the value of privacy and disclosure unless you account for the relative power levels of the discloser and the disclosee. If I disclose information to you, your power with respect to me increases. One way to address this power imbalance is for you to similarly disclose information to me. We both have less privacy, but the balance of power is maintained. But this mechanism fails utterly if you and I have different power levels to begin with. An example will make this clearer. You're stopped by a police officer, who demands to see identification. Divulging your identity will give the officer enormous power over you: He or she can search police databases using the information on your ID; he or she can create a police record attached to your name; he or she can put you on this or that secret terrorist watch list. Asking to see the officer's ID in return gives you no comparable power over him or her. The power imbalance is too great, and mutual disclosure does not make it OK.
As a frequent advocate of transparency as a way to normalize power in a society I must clarify my position in light of these valid objections. Schneier very correctly points to "The Transparent Society" as an utopian ideal. Perhaps it is a tired trope, but I'd like to point out that "utopia" originally meant "no place". That is, a place of total transparency and thus balanced power is an unachievable goal on its face. I advocate movement toward such a society in a way that---unlike Schneier assumptions about such ideas---maintains as much power as possible within the hands of those currently on the lower end of the scale. This is where cryptography and other protectors of your information/privacy come in. I disagree with Schneier's claim that there is an inherent value in privacy; it is only there to equalize the balance. Thus, believing in transparency doesn't mean you accept a "me first" approach. One does not necessarily expose oneself first in the hope of the powerful following suit. Rather, the power-knowledge of the elite must be systematically broken down while protecting our own zealously all the while. Eventually, we should reach a sort of detente in the matter. There are common-good externalities to transparency that are substantial, but as Schneier warns, we must equalize initial powers as much as possible before going "clear". Otherwise, the individual benefits are small, and the opportunity for exploitation increases. Caveat Patefactor!

Making the Most of Amazon.com

Two sites that will help you make more of Amazon.com:
  • DealLocker Amazon Discount Search lets you search Amazon by the rate of discount.
  • FillerItem lets you put in the amount you are short to get the Amazon Free Super Saver Shipping, so you can get a product as close to that as possible, to save yourself both the shipping charges and whatever you may overpay in your overzealous purchasing to attempt to fill the gap!

International War That Can Work?

One of my favourite TED talks ever:
In this bracingly honest and funny talk, international security strategist Thomas P.M. Barnett outlines a post-Cold War solution for the foundering US military: Break it in two. He suggests the military re-form into two groups: a Leviathan force, a small group of young and fierce soldiers capable of swift and immediate victories; and an internationally supported network of System Administrators, an older, wiser, more diverse organization that actually has the diplomacy and power it takes to build and maintain peace.

The Most Important Things You'll Read This Month

One of the most important things you can do is keep the Robbers Cave experiment in your mind at all time. Two groups of culturally homogeneous boys were slowly introduced to one another, and conflict blazed out of nowhere. Just the mere grouping caused the boys to detect minute differences and exaggerate them until two distinct cultures emerged, at odds and in constant competition. Only a tough common problem united them in a single struggle. Only after several more of these combined efforts did they decrease hostilities. Go! Go read it now!

The Wisdom of Crowds and Democracy

Democracy is founded on giving people the right to self-determination and the illusion that this is a good method by which to extract collective intelligence. There is not the problem of the mob but quite the opposite: it is the massed individual stupidity which brings down the democratic endeavor. Let us look at an example: There is a large jar filled with jelly beans---such as may be found at fairs and such---and people attempt to guess the correct number as closely as possible. What has been found is that people are usually wildly off the mark, and more often than not they follow a bias in one direction. However, the average of guesses is amazingly close to the real number. Imagine following a standard democratic prescription, however, and merely picking the number most guessers chose (the mode) or even the middle value (the median): you would not get a good result at all! (Update: Robin Hanson (see below) says the median often gives results even better than the average, so... that would also work! :>) Why should we then use a method this wretched to solve a problem not far off, namely that of electing our leaders? Further Reading:

What the Roads Can Teach Us

I've often looked to the roads, traffic, and vehicle-pedestrian interaction as a guide to human to behavior. It is a situation where the risk is very high and communication is highly constrained, so behavior strategies are more readily apparent. Most of us know the roads as strongly structured environments with mostly clear rules regulating behavior, with fairly stiff penalties placed on violators. The theory being that the restricted communication and great complexity of navigating the roads and streets should be offset by the strict direction of behavior and heavy punishment to deter deviation. In practice, those who cheat will win. Most people are risk-averse enough to allow the few bold and brash to take advantage of that for consistent gain. Alas, this leads to situations where this opportunistic behavior leads to disaster. But this isn't the only problem. In recent years, more and more studies have come out showing that at least some of the problems on the roads stem from overconfidence which stems from the various risk-reducing tools we use. Seat belts tend to promote risky driving, although they certainly reduce fatilities by a huge percentage. A recent experiment by a professor at the University of Bath had him biking and measuring the behavior of cars that drove past. When not wearing a helmet he was given a much wider berth than when doing so. Even more space was granted when he donned a woman's wig. This seems to indicate that the safety granted by the helmet encouraged drivers to take more risks in regards to the cyclist. Once again, bicycle helmets have an immensly beneficial effect in reducing fatalities to mere injuries, so this study should most certainly not be construed as a reason not to don one. Taking this type of data into account, what can be done to improve the safety of everyone involved? An idea of growing popularity is that of a Shared Space, pioneered by the Dutch traffic engineer Hans Monderman. This is a model where nearly all traffic markings are removed from an area. This includes signs, traffic lights, and even the clear distinction between road and sidewalk. Intersection are converted into roundabouts. The results from the several implementations of this model are overwhelmingly positive. This removal of strict direction forces all those involved, pedestrians and drivers alike, to pay much more attention to their environment. It demands the interaction via eye-contact and implicit behavior adjustment of all participants. The result is the smooth operation of traffic, where average speeds drops, but total trip times shorten, as well as huge improvement in safety --- fatality and injury rates plummet. After the initial period of habituation, no extreme vigilance from pedestrians or motorists is required as the more cautious behavior is internalized. I contend that what can work in the street can also work in other areas of life where many demand regulation and strict control for the safety of all. No external authority or risk-reducing device can substitue for personal vigilance, skepticism, and common sense. And in many cases, as the above examples illustrate, relying on our own individual virtues can be much superior.