Search, NAY Medical Informatics: The Semantic-Web “Killer-App”

April 4, 2008

Why do we need a “semantic-web” ? (Web) search appears as one compelling application so far …. however the user honestly seen anything useful and scalable yet …. Powerset - hurry up !!

However it seems to medical and clinical informatics is one community that has really adopting (and wisely so) semantic-web technologies to address their knowledge sharing, search, retrieval etc needs in a specialized domain. This may well be the “killer-app” for semantics technologies.

Return to Barbarianism in Mumbai, India

February 21, 2008

In a shocking set of outbursts, members of a chauvinistic, local
political party (the “MNS”) sought a solution to an overflow of
migrant population in the western Indian city of ‘Mumbai’ (formerly
Bombay, India’s financial captial and, till now, regarded as a
cosmopolis) by unleashing violent physical attacks on **outsiders**
(Indian citizens, mind you, but from states outside Maharashtra
which is where Mumbai is).

By and large, hooligans from this party in the last few weeks succeeded
in beating, injuring and terrorizing such “outsiders”, working as cab
drivers, laborers etc in the city - to the extent that thousands have
fled the city in fear.

I have never lived in Mumbai as such, though I have many good friends
and colleagues from this state and would only vouch that this
chauvinism is not representative of the people there. Migration
and right to work issues are contentious, but never WITHIN a country !!
Without going into any debate on who does or does not have a
right to live and work in this or any other city, what is appalling is
the complete state and constitutional failure in this matter. The
MNS hooligans and their party leader, a Mr “Raj Thackeray” roam
free and unaccountable after the violence they unleashed.

As Indian citizens we should demand:

1. Prosecution of the party leader Thackeray and members as terrorists,
for unleashing violence and terror on innocent, hardworking, poor citizens.

2. Sue the party for physical injury, loss of livelihood, and dislocation caused
to the fleeing “outsiders”.

3. Sue the party for hundreds of millions of dollars in losses to local
industrycaused as a result of the resulting labor shortage.

4. Bring the state and police authorities to account for failing to
protect and reassure Indian citizens and their families within India.

Otherwise we leave the possibility open that the Indian state is so weak
and incapable of protecting its citizens’ fundamental rights, that for any
issues rather than addressing them constitutionally and legally -
we find the option of sending a few hundred hooligans into the
street to barbarically make our point, more appealing and effective. (more…)

Our Article on EII

January 22, 2008

Our EII article is out in this month’s edition of DM Review Magazine.

This is a good overview of the “schema-less” data integration approach we have been advocating from the NETMARK work at NASA Ames.

MySQL Acquisition

SUN acquired MySQL last week for $1B.
What does this bode for open-source DBs, and open-source software in general …. ?

XAR Extraction System

August 18, 2007

This is an information extraction system for relation (slot-filling) extraction from free text. Details at http://www.ics.uci.edu/~ashish/xar/

We hope to be able to make it available to the community very soon.

Of Elephants and Dragons

July 26, 2007

I was at Robyn Meredith’s book reading of “Elephants and Dragons: The Rise of India and China” at the VRomans book store yesterday. The book rather accurately touches on many issues in these growing economies on everyone’s radar. I however think there is an overtly high degree of paranoia on issues like outsourcing of jobs etc. If anything it is probably just a wake up call to countries like the US as to how more critical, than ever before, it has become to be at the leading edge of innovation, invest in education etc etc.

The “threat”, “new order”, “tectonic shift” … whatever posed by the developing economies has to be examined more carefully. At the lower level i.e., outsourcing of jobs such as the call center or tech support jobs I think yes it will cause some temporary pain in terms of US job losses but in the longer term this translates to savings that can be invested in new products and R&D. Then let us (taking software as an example) look at something higher in the intellectual value chain, such as the development of high-end services or products. Yes, here the playing field is changing, the rules are the same … compete or perish … but you new players in the field now. Finally, I believe overall we are moving into an era of even higher growth, creating opportunities that were previously unthinkable. Fundamentally newer kinds of businesses, newer kinds of companies, newer demands for products and services. It is the growing economy in India that then goes back to create the demand for things such Boeing air buses for its (very) rapidly increasing domestic air travel industry or even online ticketing software for that.

I think the US workers need to appreciate and even embrace this change in some fashion; given that there are tremendous possibilities that will benefit us all.

Paper submissions, rejections, Ghalib

June 7, 2007

Life .. is turning out to be about publications. One
submission after another. But submissions these days
result in rejections, far too often, painful ones. I have
found solace in the musings of Ghalib, a 19th century
Indian poet (and more).

He says

“har ek baat pe kehte ho tum ke ‘too kya hai’ ?
tumheeN kaho ke yeh andaaz-e-guftgoo kya hai ?”

Roughly translates to:

At every utterance you tell me …what is this ? what are you ?
Well then you tell me, what is this manner of conversation.

After a particuarly depressing review:

“rahee na taaqat-e-guftaar, aur agar ho bhee
to kis ummeed pe kahiye ke aarzoo kya hai ?”

Translates to:

i don;t have the tenacity to argue, and even if so
tell me … what hopes do you have for me.

The Technology of Education

June 3, 2007

Teaching, education, access to quality instruction….. we have been hotly discussing these issues
here in India in recent times, and a central problem or crisis that has been highlighted is that the access to quality education in India is still seriously limited. “Demand” seriously outstrips “supply”. This assessment of the state of affairs is, unfortunately, true and applies to the entire spectrum from basic primary to professional or college level education. Let me focus on professional education. A particular crisis of sorts is in place for top-tier engineering and management education where a paucity of quality faculty is acute. A question I pose is whether we as technologists, particularly in information technology can do something to improve the state of affairs. I think the answer is in the affirmative even with the available technologies we have, and I also see a tremendous, almost historic opportunity for significant technological advancement driven by the need today.

Can technology, particularly IT, alleviate the education crisis ?

The benefits of IT and our networked world have been much raved about, but let me revisit that briefly. The access to information is instant, the degree of replication is practically infinite, storage and archival of information is cheap and scalable. A lot of this access and benefits are in developing countries as well, most certainly the urban middle class in India, and access in rural areas too can and will increase in the years to come. The access to information has increased dramatically, it is also fair to say that the access to knowledge has increased. One has access to online books, tutorials, encyclopedias, online self-evaluation exams and what not. For many professional topics, particularly common undergraduate courses one easily comes across entire sets of class slides. While significant, we have merely scratched the surface here. If we look at just what we can do with the technology that we have available today, the possibilities are enormous. More multi-media content of the subject material, digitized videos of entire lectures, and other material all neatly organized, browsable, searchable, downloadable. The IITM NPTEL initiative is a fine example of this. But we can raise the bar here. For instance search technology that helps a student get to the relevant portions given his quest “what is the basic notion of object orientedness ? “. An “give me an example” button along with the online course material she is browsing. The online course material in its present form will benefit the more “prepared” student, a computer science student who wishes to learn from the material by himself, an IT professional looking to learn about a new area etc. But this accessibility bar needs to be brought lower. And one way this will happen is with better search and retrieval methods. I do not have satisfactory means to day to search for “a tutorial that provides a basic introduction to SVMs”, or “what is the difference between multi valued dependencies and regular functional dependencies”.

Now let us get bolder. Envision a “teaching intelligent agent”, software that can “teach”. That can introduce, guide and lead a student through the course material. That can evaluate his understanding. That the student can interact with for clarifications, questions. Any artificial intelligence (AI) researcher today will tell that we have years to go before we address many of the underlying hard research challenges that have to be addressed before such an agent can be realized. True, but it is evolution that must lead to revolution. We can go “bottom-up” here, from the online tutorials and evaluations we have today to something a level more interactive tomorrow, perhaps with features such as visual interaction the step after and so on. In fact this i.e., the use of software itself for teaching and training is now an active area of research ( ). Intelligent tutoring agents have already been developed and used for military instruction.

Literally any civilization has over the centuries seen periods or rather events or innovations of immense impact, that have literally revolutionized the way knowledge is created, managed (stored or recorded) and imparted. Such “revolutions” have actually been both social as well as technological, but let me consider the technological part. Perhaps the written script is the first such, the development and advent of print technology would be another. And we in our time have witnessed the arrival of digitized media and the internet. The impact on education amongst other things has been significant in this short span of time. Let us take on this challenge. Let us design, develop, implement, research teaching information technologies. Amartya Sen asked a rather worthy question a the central theme of his address to NASCOMM, which is”what can IT do for India” (Google: “amartya sen nasscom keynote 2007” ? We are poised today where we stand with world class IT infrastructure and a large pool of professionals. But history has also placed us at a point where hundreds of thousands of young people would benefit immensely from access to quality professional education. What a worthy challenge !

incredible India

May 10, 2007

We just came back from a restful, colorful, eventful trip to
India. We spent time in Bangalore and Pune and a day each
in Lucknow and Agra. Some highlights/significant mentions.

- We saw Infosys city, the Infosys campus in Bangalore
and it was mind blowing. Its not an exaggeration that
few campuses even in the US or Europe would match
this in size, aesthetics, employee facilities and
environment friendliness. Infosys campus

Infosys campus, Bangalore

- Traffic in Bangalore is bad but about as bad as any other
big Indian city. Pollution levels though have really come
down in bangalore as well as other cities, thanks to CNG
initiatives.

- A sea change in progress for upper middle and middle class
consumers with sprawling shopping malls, megaplex stores
such as lifestyle and homestop, food courts and what not.
This is good for consumers as we in India are now getting more
conscious about things like quality, customer service etc.
Besides these are engines for job growth. Homestop, in Bangalore
Homestop store, Bangalore: Reflective of the new consumer wave in India

- Regardless of my coordinates anywhere on the planet, I will
gravitate to a nice coffee shop. Was delighted to see Cafe Coffee Day
(India’s answer to Starbucks) every few km (at least in Bangalore).

We are “wiki ing” for it now

March 30, 2007

I end up wiki ing i.e., consulting wikipedia on a near daily basis …from what to do for a minor burn injury to travel planning to quickly recalling theorems and np-complete problems in my latent memory.

My mom uses wikipedia in India now, having started with lookups for math proofs and solutions for the math tutoring and consulting she does post retirement these days.

Mr Jimmy Wales may well have here what can give Google a run for their money in the coming days …. ?