Wednesday, April 11, 2007

Crazyfinger makes an interesting comment on Jeff Jarvis's blog.

Deadwood. The blogosphere of today feels like that town, with its own version of Swearengens, E. B. Farnums...

There is a lot of background to this, worth unpacking; it can all be distilled, however, to the observation that people are sometimes mean on the internet.

The long version goes something like this.  Kathy Sierra, who is an admired web design guru, Web 2.0 advocate, and co-author of the immensely popular Head First series of technical books, has a blog.  And recently people started making obnoxious comments on her blog, obnoxious comments on other blogs about her, works of Photoshop clipping involving her, and finally death threats.  She is now considering getting out of the blogosphere altogether, a dramatic instance of Gresham's law at work.  In the meantime, however, it turns out she has some notable friends who are now trying to use their influence to do something about the netnasties.  Tim O'Reilly, who runs a successful technical press and also helped coin the term Web 2.0, proposes a blogger code of conduct to which bloggers can sign on as a mark of their bona fides.

In other milieus, this mild suggestion of self-regulation would seem perfectly reasonable, but the internet is not just any milieu.  It has mythic origins as an unregulated medium for the transmission of ideas and great hopes -- democratic ideals, anarchic utopias, freedom of speech, freedom of expression -- are tied to it.  The wildness of the internet contributes to its appeal.  Like the American frontier, it is a terrain where anyone can re-create themselves, and build a new culture in which they can happily dwell.

This conjoining of freedom, the Internet, the blogosphere, Web 2.0, and the Open Source movement was at one time promoted by the same people who are finding problems with it now.  In a 2006 commencement speech at UC Berkeley's School of Information, Tim O'Reilly said:

The internet has enormous power to increase our freedom. It also has enormous power to limit our freedom, to track our every move and monitor our every conversation. We must make sure that we don't trade off freedom for convenience or security.

In his own explication of what his neologism Web 2.0 meant, O'Reilly wrote:

If an essential part of Web 2.0 is harnessing collective intelligence, turning the web into a kind of global brain, the blogosphere is the equivalent of constant mental chatter in the forebrain, the voice we hear in all of our heads. It may not reflect the deep structure of the brain, which is often unconscious, but is instead the equivalent of conscious thought. And as a reflection of conscious thought and attention, the blogosphere has begun to have a powerful effect.

Kathy Sierra has been more consistent in her view of the openness of the Internet.  In 2005 she discussed the enforcement of "be-nice" rules on a forum she started.

Enforcing a "be nice" rule is a big commitment and a risk. People complain about the policy all the time, tossing out "censorship" and "no free speech" for starters. We see this as a metaphor mismatch. We view javaranch as a great big dinner party at the ranch, where everyone there is a guest. The ones who complain about censorship believe it is a public space, and that all opinions should be allowed. In fact, nearly all opinions are allowed on javaranch. It's usually not about what you say there, it's how you say it.

And this isn't about being politically correct, either. It's a judgement call by the moderators, of course. It's fuzzy trying to decide exactly what constitutes "not nice", and it's determined subjectively by the culture of the ranch.

At the same time, it was also she who pointed out, quite accurately, this principle of the Internet:

If we want our users (members, guests, students, potential customers, kids, co-workers, etc.) to pay attention, we have to be provocative. We can moan all we want about how the responsible person should pay attention to what's important rather than what's compelling. But it's not about responsibility or maturity. It's not even about interest.

...

Provocation is in the eye of the provoked, obviously, so there's no clear formula. But there's plenty we can try, depending on the circumstances....

These notions of the Internet age as herald to a new form of social interaction even permeates seemingly unrelated movements like the  Agile Methodology for software development, which promotes:

Individuals and interactions over processes and tools
Working software over comprehensive documentation
Customer collaboration over contract negotiation
Responding to change over following a plan

Even the Open Source movement, which promotes a particular way of distributing software, includes these interesting stipulations in the license they promulgate:

5. No Discrimination Against Persons or Groups

The license must not discriminate against any person or group of persons.

6. No Discrimination Against Fields of Endeavor

The license must not restrict anyone from making use of the program in a specific field of endeavor. For example, it may not restrict the program from being used in a business, or from being used for genetic research.

By open, they truly mean open.  Given this emphasis on ideals of individuality, freedom, and equality in Internet culture, it can be seen why any suggestion that it might be in everyone's interest to curtail any of these is seen as anathema.  It also explains the strange bind those working on O'Reilly's proposed blogger's code of conduct find themselves in.  Once it was agreed upon that some sort of action should be taken to deal with the netnasties, it was discovered that nothing could really be done without enforcement, and no one wants enforcement since it is a form of coercion.  Consequently, the code of conduct has turned out to be a document that offends half of the Internet by suggesting mild coercion in the first place, and then draws the dirision of the other half by having no teeth.  The draft code of conduct is currently in a state of flux, and may change radically over the next several weeks.  At one point, however, it included an article that stated that bloggers don't take themselves seriously.  The intent of this was somewhat lost to me, but the irony was not.  Bloggers don't take themselves seriously, and yet they feel they need a code of conduct to explicate what they believe in, including the tenet that they don't take themselves seriously.

As it is shaping up, though, the code of conduct ressembles to a remarkable degree the bylaws of various community forums across the Internet.  What separates forums from blogs is, primarily, that forums are composed of people who consent to obey the oversight of moderators as a mechanism for regulating discussions.  Blogs, on the other hand, are visible and generally accessible to everyone.  Forums usually have mechanisms in place to eject members who repeatedly behave badly.  The Internet has no such mechanism.  Finally, forums usually only provide one with an audience of a hundred to a thousand people.  Blogs offer a potential audience of hundreds of millions of people.

It is likely for this last reason that many people have turned to blogs, rather than forums, as their main outlet for Internet discourse.  If gold was the main currency of the Old West, attention is the main currency of the new frontier -- or, as advertisers like to call it, eyeballs.  The public life of many people on the Internet involves acquiring eyeballs, which can then be converted to real money if one chooses to advertise on one's site, or else may simply be used as a mode of social promotion.  Returning to moderated forums is akin to returning to the towns back East where laws were more stringent, and safety more assured, but opportunities for advancement and transformation were limited.  The blogosphere holds out the promise that anyone can be famous if they turn the right phrase, capture the right attention, come up with the next big idea.

For these very reasons, however, the rules of a community cannot be enforced where no laws exist.  How then does justice get enforced on the digital frontier?

As Crazyfinger (who has an interesting blog of his own about Adam Smith's Theory of Moral Sentiments) suggests, an analogy can be drawn between the TV drama Deadwood and the current state of the Internet.  Had Deadwood survived another season, we might even have received a definitive answer, but as it is, we only have suggestions.

Deadwood, in the show of the same name, is a gold town in South Dakota marching slowly toward incorporation and civilization.  Alma Garret (a proxy for Kathy Sierra) has accidentally struck it rich when her lot is discovered to contain one of the richest gold veins in the region.  As a consequent, she is a victim of unscrupulous persons anxious to take hold of her, ermm, eyeballs.  Having neither reputation to lose nor character to restrain them, they act provacatively in their efforts to raise their own social status.

Throughout the series, three main ways are provided to afford Alma Garret the protection of civilization she requires, in a place without civilization.  The first is Wild Bill Hickock, who through the authority granted him by his reputation, is able to coerce people to behave appropriately.  This is analogous to the the attempt by Kathy Sierra's friend Tim O'Reilly, as well as others, to use their reputations to shame people into agreeing to some sort of blogging standards.  Sadly, the attempt is also analogous to the letter written by the town fathers in Season Three in the local paper to turn sentiment against George Hearst, who has designs on Alma's gold.  Wild Bill, of course, is shot at the end of Season One.  Best character on TV ever.  Nuff said.

Alma Garret's second line of defense is Sheriff Seth Bullock.  Bullock is of heroic proportions.  Through the exercise of precise and barely restrained violence, Bullock is able to herd and intimidate those who would upset the peace of Deadwood.  Bullock is the equivalent of the sort of hero we occassionally encounter in forums and message boards, who through wit, knowledge, and force of character is able both to inspire people to behave better as well as punish with an acid tongue those who do not.  Alas, on the Internet, there are too few of these, and the few there are tend to retreat into their own preoccupations over time.  A case again, perhaps, of Gresham's Law: bad money drives good money out of circulation.

The last option Alma Garret has at her disposal is to accede to the wishes of the villainous and violent George Hearst on the best terms she is able.  This is what Alma Garret does at the end of Season Three, rather than force a confrontation that would likely see many of the main characters killed off.  This, as far as I can see, is the only way to bring civilization to the blogosphere, and it is an unhappy turn.  Civilization, once we accept that there will always be netnasties, is only possible when we turn a monopoly of coercive power over to a single entity.  If, as O'Reilly, Sierra and others have argued, it is necessary to make the blogosphere and the Internet, by extension, obey the rules of a community forum, then something like this must occur.  The most likely way for this to happen is if one of the main social networking sites joins forces with one of the major blogging hosts, such as Typepad or LiveJournal, and compels everyone who wants to blog to sign on to their service, following the other principle of the Internet that growth engenders growth.  Having acquired a majority share of the blogosphere, such a monopolistic regime can then enforce community rules such as the ones Tim O'Reilly is attempted to formulate.  This entails the victory of Hearst and of civilazation, and the closing of the frontier.

And, I think, it is also the moral of Deadwood, if there is a moral to be found.  The frontier gives us heroes, but it also engenders monsters.  The idealized vision of the frontier must at some point be confronted with the ugliness it foments; a place of greed, corruption, mysogeny, pornography and guys who say "cocksucker".  If we can't find it in ourselves to embrace the ugliness along with the heroism of the frontier, then we must make the great compromise and bear the yoke which assures civility, and which, Rousseau promises, is only a light yoke, after all.

posted by J Ashley on Tuesday, April 10, 2007 11:54:31 PM (Eastern Standard Time, UTC-05:00)  #    Comments [0]
 Sunday, April 08, 2007

The Clementinum Baroque Library, Prague

I have been looking through my library shelves, picking out books I once read for signs of what I once saw in them.  I no longer remember.  All I find are rare page corners delicately turned over.  I have never been able to pick up the habit of actually touching ink to my books, which has always struck me as a sort of desecration of the text.  Nevertheless, I do find chocolate and nicotine stains on the edges, occassionally, and from books I have not openned since college, I am often rewarded with the foul whiff of stale cigarettes smoked long ago, a scent no doubt mirrored internally as a black smear on my lungs.  As I peruse these pages with their foreshortenned corners, a sign from my past self to my future self that here there be something of note, I wonder what I used to know that I no longer know, and what I thought I knew but now I know better.  This is one such passage.

 

In ancient times the painters were supplied with their themes by the poets, though at liberty to indulge in as much decorative play as was decent within the limits of a given theme; later, the failure of the poets to keep their position at the head of affairs forced painters to paint whatever their patrons commissioned, or whatever came to hand, and finally to experiment in pure decoration; now affectations of madness in poets are condoned by false analogy with pictorial experiments in unrepresentational form and colour.  So Sacheverell Sitwell wrote in Vogue (August, 1945):

Once again we are leading Europe in the Arts ...

He lists the fashionable painters and sculptors and adds:

The accompanying works of the poets are not hard to find ... Dylan Thomas, whose texture is as abstract as that of any modern painter ... There is even no necessity for him to explain his imagery, for it is only intended to be half understood.

It is not as though the so-called surrealists, impressionists, expressionists and neo-romantics were concealing a grand secret by pretended folly, in the style of Gwion; they are concealing their unhappy lack of a secret.

For there are no poetic secrets now, except of course the sort which the common people are debarred by their lack of poetic perception from understanding, and by their anti-poetic education (unless perhaps in wild Wales) from respecting.  Such secrets, even the Work of the Chariot, may be safely revealed in any crowded restaurant or cafe without fear of the avenging lightning-stroke: the noise of the orchestra, the clatter of plates and the buzz of a hundred unrelated conversations will effectively drown the words -- and, in any case, nobody will be listening.


-- Robert Graves, The White Goddess

Today, the Work of the Chariot has its own flash-enabled web page, as well as a Wikipedia entry.  There was even an X-Files episode in which it served as a narrative device. 

posted by J Ashley on Sunday, April 08, 2007 11:34:59 AM (Eastern Standard Time, UTC-05:00)  #    Comments [0]
 Thursday, April 05, 2007

"So that I’m the only person who knows?"

"The only person in the world."

"Well," she quickly replied, "I myself have never spoken.  I've never, never repeated of you what you told me."  She looked at him so that he perfectly believed her.  Their eyes met over it in such a way that he was without a doubt.  "And I never will."

She spoke with an earnestness that, as if almost excessive, put him at ease about her possible derision.  Somehow the whole question was a new luxury to him—that is from the moment she was in possession.  If she didn't take the sarcastic view she clearly took the sympathetic, and that was what he had had, in all the long time, from no one whomsoever.  What he felt was that he couldn't at present have begun to tell her, and yet could profit perhaps exquisitely by the accident of having done so of old.  "Please don't then.  We're just right as it is."

"Oh I am," she laughed, "if you are!"  To which she added: "Then you do still feel in the same way?"

It was impossible he shouldn't take to himself that she was really interested, though it all kept coming as a perfect surprise.  He had thought of himself so long as abominably alone, and lo he wasn't alone a bit.  He hadn't been, it appeared, for an hour—since those moments on the Sorrento boat.  It was she who had been, he seemed to see as he looked at her—she who had been made so by the graceless fact of his lapse of fidelity.  To tell her what he had told her—what had it been but to ask something of her? something that she had given, in her charity, without his having, by a remembrance, by a return of the spirit, failing another encounter, so much as thanked her.  What he had asked of her had been simply at first not to laugh at him.  She had beautifully not done so for ten years, and she was not doing so now.  So he had endless gratitude to make up.  Only for that he must see just how he had figured to her.  "What, exactly, was the account I gave—?"

"Of the way you did feel?  Well, it was very simple.  You said you had had from your earliest time, as the deepest thing within you, the sense of being kept for something rare and strange, possibly prodigious and terrible, that was sooner or later to happen to you, that you had in your bones the foreboding and the conviction of, and that would perhaps overwhelm you."

"Do you call that very simple?" John Marcher asked.

She thought a moment.  "It was perhaps because I seemed, as you spoke, to understand it."

"You do understand it?" he eagerly asked.

Again she kept her kind eyes on him.  "You still have the belief?"


-- Henry James, The Beast in the Jungle

posted by J Ashley on Thursday, April 05, 2007 8:33:34 AM (Eastern Standard Time, UTC-05:00)  #    Comments [0]
 Wednesday, April 04, 2007


In the name of God, the Merciful, the Compassionate.

Someone asked the eminent shaykh Abu 'Ali b. Sina (may God the Exalted have mercy on him) the meaning of the Sufi saying, He who knows the secret of destiny is an atheist.  In reply he stated that this matter contains the utmost obscurity, and is one of those matters which may be set down only in enigmatic form and taught only in a hidden manner, on account of the corrupting effects its open declaration would have on the general public.  The basic principle concerning it is found in a Tradition of the Prophet (God bless and safeguard him): Destiny is the secret of God; do not declare the secret of God.  In another Tradition, when a man questioned the Prince of the Believers, 'Ali (may God be pleased with him), he replied, Destiny is a deep sea; do not sail out on it.  Being asked again he replied, It is a stony path; do not walk on it.  Being asked once more he said, It is a hard ascent; do not undertake it.

The shaykh said: Know that the secret of destiny is based upon certain premisses, such as 1) the world order, 2) the report that there is Reward and Punishment, and 3) the affirmation of the resurrection of souls.


-- Avicenna, On the Secret of Destiny (tr. George Hourani)

posted by J Ashley on Wednesday, April 04, 2007 5:25:25 PM (Eastern Standard Time, UTC-05:00)  #    Comments [0]
 Monday, April 02, 2007

 

Download SAPISophiaDemo.zip - 2,867.5 KB

 

Following on the tail of the project I have been working on for the past month, a chatterbox (also called a chatbot) with speech recognition and text-to-speech functionality, I came across the following excerpted article in The Economist, available here if you happen to be a subscriber, and here if you are not:

 

Chatbots have already been used by some companies to provide customer support online via typed conversations. Their understanding of natural language is somewhat limited, but they can answer basic queries. Mr Carpenter wants to combine the flexibility of chatbots with the voice-driven "interactive voice-response" systems used in many call centres to create a chatbot that can hold spoken conversations with callers, at least within a limited field of expertise such as car insurance.

This is an ambitious goal, but Mr Carpenter has the right credentials: he is the winner of the two most recent Loebner prizes, awarded in an annual competition in which human judges try to distinguish between other humans and chatbots in a series of typed conversations. His chatbot, called Jabberwacky, has been trained by analysing over 10m typed conversations held online with visitors to its website (see jabberwacky.com). But for a chatbot to pass itself off as a human agent, more than ten times this number of conversations will be needed, says Mr Carpenter. And where better to get a large volume of conversations to analyse than from a call centre?

Mr Carpenter is now working with a large Japanese call-centre company to develop a chatbot operator. Initially he is using transcripts of conversations to train his software, but once it is able to handle queries reliably, he plans to add speech-recognition and speech-synthesis systems to handle the input and output. Since call-centre conversations tend to be about very specific subjects, this is a far less daunting task than creating a system able to hold arbitrary conversations.

 

Jabberwacky is a slightly different beast than the AIML infrastructure I used in my project.  Jabberwacky is a heuristics based technology, whereas AIML is a design-based one that requires somebody to actually anticipate user interactions and try to script them.

All the same, it is a pleasant experience to find that one is serendipidously au courant, when one's intent was to be merely affably retro.

posted by J Ashley on Monday, April 02, 2007 1:50:41 PM (Eastern Standard Time, UTC-05:00)  #    Comments [0]