Apache Hadoop community blog

September 29, 2009

NSF, Google, IBM CLuE PI Meeting: October 5, 2009

Filed under: Conference — mainec @ 7:41 pm

Information taken from the announcement on the Hadoop Common user list by Jimmy Lin.

==CLuE PI Meeting 2009==

Monday, October 5, 2009
Computer History Museum
Mountain View, California

Sponsored by the National Science Foundation, Google, IBM
Organized by the University of Maryland Cloud Computing Center

Website: https://wiki.umiacs.umd.edu/ccc/index.php/CLuE_PI_Meeting_2009
Registration: http://clue2009.eventbrite.com/

= What’s this event about?

In October 2007, Google and IBM announced the first pilot phase of the
Academic Cloud Computing Initiative (ACCI), which granted several
prominent U.S. universities access to a large computer cluster running
Hadoop, an open source distributed computing platform inspired by
Google’s file system and MapReduce programming model. In February 2008,
the ACCI partnered with the National Science Foundation to provide grant
funding to academic researchers interested in exploring large-data
applications that could take advantage of this infrastructure. This
resulted in the creation of the Cluster Exploratory (CLuE) program led
by Dr. Jim French, which currently funds 14 projects. See this NSF Press
Release for a short description of all the projects funded under the
CLuE program.

Nearing the two year anniversary of this collaboration, the National
Science Foundation, Google, and IBM will be jointly sponsoring a meeting
for the CLuE project principal investigators (PIs). This will event will
be open to the public—in fact, the explicit goal of this event is to
showcase the exciting research currently underway in academia and
promote closer ties with the broader “cloud computing” community in the
bay area.

= Schedule at a Glance

See below for an overview of talks scheduled for the day. We are pleased
to welcome two keynotes, by Hamid Pirahesh from IBM (in the morning) and
Luiz Barroso from Google (in the afternoon). The meeting will be capped
off with a poster reception in the early evening, where representatives
of all CLuE projects will present their work in a more informal setting.

Morning Session

(07:30 – 08:00) Registration and breakfast

(08:00 – 08:30) Introductions

(08:30 – 09:15) IBM keynote: Impact of Cloud Computing on Research in
Extreme Scale Analytics. Hamid Pirahesh

(09:15 – 09:40) Topic-Partitioned Search Engine Indexes. Jamie Callan,
Jaime Arguello, Anagha Kulkarni (CMU)

(09:40 – 10:05) Indexing Geospatial Data with MapReduce. Naphtali Rishe,
Vagelis Hristidis, Raju Rangaswami, Ouri Wolfson, Howard Ho, Ariel Cary,
Zhengguo Sun, Lester Melendes (Florida International University)

(10:05 – 10:30) Morning coffee break

(10:30 – 10:55) Scalable Graph Processing in Data Center Environments.
Ben Zhao, Xifeng Yan, Divyakant Agrawal, Amr El Abbadi (University of
California, Santa Barbara)

(10:55 – 11:20) Large-Scale Data Cleaning Using Hadoop. Chen Li, Michael
Carey, Alexander Behm, Shengyue Ji, Rares Vernica (University of
California, Irvine)

(11:20 – 11:45) Cluster Computing for Statistical Machine Translation.
Stephan Vogel, Qin Gao, Noah Smith, Kevin Gimpel, Alok Parlikar, Andreas
Zollmann (CMU)

(11:45 – 12:10) Research and Education with MapReduce/Hadoop:
Data-Intensive Text Processing and Beyond. Jimmy Lin, Tamer Elsayed,
Chris Dyer, Philip Resnik, Doug Oard (University of Maryland)

Afternoon Session

(1:00 – 1:45) Google keynote: Datacenter-Scale Computing. Luiz André Barroso

(1:45 – 2:10) A Performance and Usability Comparison of Hadoop and
Relational Database Systems. Sam Madden, Andrew Pavlo, Erik Paulson,
Alexander Rasin, Daniel Abadi, David DeWitt, Michael Stonebraker (MIT,
Brown, University of Wisconsin, Microsoft, Yale)

(2:10 – 2:35) HadoopDB An Architectural Hybrid of MapReduce and DBMS
Technologies for Analytical Workloads. Daniel Abadi, Azza Abouzeid,
Kamil Bajda-Pawlikowski (Yale University)

(2:35 – 3:00) Towards Interactive Visualization in the Cloud. Bill Howe,
Huy Vo, Claudio Silva, Juliana Friere, YingYi Bu (University of
Washington, University of Utah)

(3:00 – 3:30) Afternoon coffee break

(3:30 – 3:55) Scaling the Sky with MapReduce/Hadoop. Andrew Connolly,
Jeff Gardner, Simon Krughoff (University of Washington)

(3:55 – 4:20) Commodity Computing in Genomics Research. Mihai Pop, Mike
Schatz (University of Maryland)

(4:20 – 4:45) Relaxed Synchronization and Eager Scheduling in MapReduce.
Ananth Grama, Suresh Jagannathan (Purdue University)

(4:45 – 5:10) Dynamic Provisioning of Data Intensive Applications.
Chaitanya Baru, Sriram Krishnan (San Diego Supercomputer
Center/University of California, San Diego

September 3, 2009

Third Hadoop in China event

Filed under: Conference — mainec @ 10:23 pm

Sponsored by Yahoo! and Cloudera the third Hadoop in China is scheduled to take place in November 2009. CfP and registration page are currently open.

  • What: Hadoop in China event.
  • Where: Beijing
  • When: November 15th, 2009.

See http://www.hadooper.cn/hadoop/cgi-bin/moin.cgi/thirdcfp for more information.

August 22, 2009

Apache Con US 2009

Filed under: Apache sponsored,Conference — mainec @ 2:10 pm

The Apache Software Foundation celebrates it’s 10th birthday this year. The first “birthday party” including cake this year took place in Amsterdam. The second edition is scheduled to take place in Oakland:


The early bird registration deadline has been extended – so in case you are still wondering whether to join in the celebrations or not: Register early to benefit from the early registration discount.

On Wednesday the conference will feature a whole track on Hadoop. On Thursday and Friday there will be two related tracks on Lucene. In addition there will be Meetups of developers interested in NoSQL databases on Monday and Tuesday: http://wiki.apache.org/apachecon/ApacheMeetupsUs09

If you want to meet the core Apache Hadoop developers, Apache Con is probably the event to attend to.

For more information, see also the Official Apache Foundation Blog

August 21, 2009

NOSQL East conference

Filed under: CfP,Conference — mainec @ 8:17 am

Brad Anderson, Chris Williams and Matthew Podwysocki are planning the NoSQL East conference in Atlanta, GA on Oct. 29-30. The focus of the submitted talks is on real world use cases, highlevel overview of architecture.

Currently they have speakers for the following systems: CouchDB, Dynomite, Cassandra, Redis, Pig, Cascading, HBase, MongoDB.

Suggestions for further submissions include but are not limited to the following topics: Project Voldemort, Tokyo, Neo4J, Riak, Kai, Hypertable, Dryad/Cosmos.

Feel free to check out more information in the mailinglist on NoSQL as well as on the conference homepage.

August 20, 2009

Hadoop World NYC 2009

Filed under: Conference — mainec @ 12:59 pm
Tags: ,

On October 2nd the Hadoop World is going to take place in NYC. The event will be split into training- and talk-sessions. The long list of topics that have been scheduled:

  • Hadoop Usage at Yahoo!, Yahoo!
  • Data Warehousing, Facebook
  • Hadoop at IBM, IBM
  • Logs Analysis, Rackspace
  • Matchmaking, eHarmony
  • Analytics and Reporting, eBay
  • Transaction Analysis, Visa
  • Protein Alignment, Booz Allen Hamilton
  • Natural Language, General Sentiment
  • Data Processing, JPMorganChase
  • Counting, Clustering and Other Tricks, NYTimes
  • Hadoop Deployment and Administration, Cloudera
  • Security, Authentication and API Stability, Yahoo!
  • Social/Network Analysis, Yahoo!
  • Vaidya: Autotune Hadoop, Yahoo!
  • Practical HBase: Getting the most from your HBase install, Microsoft
  • Monitoring Best Practices, About.com
  • Production Deep Dive with High Availability, Context Web
  • Low Latency Random HDFS Reads, Elastic Applications
  • Map/Reduce Count Optimizations, Spansion
  • Building Data Intensive Apps: TrendingTopics.org, Data Wrangling
  • A Real-Time BI Platform, Visible Measures
  • Hadoop and Clojure, Sonian Networks and Columbia University
  • Encryption in Public Clouds, Booz Allen Hamilton
  • Data Mining Platform for Telecom Industry, China Mobile
  • Email Archiving System, NexR
  • Vertica Integration with Hadoop, Vertica
  • HadoopDB: A Parallel RDMS, Yale

For more information and registration details see: conference webpage or on the Cloudera Blog

One additional comment: It is intended to put video recordings of at least a subset of the talks online after the event is over.

Create a free website or blog at WordPress.com.