Optimising scarce resources using real-time decision making

A session at Strata New York 2011

Friday 23rd September, 2011

10:40am to 11:20am (EST)

In the last few years the ubiquitous availability of high bandwidth networks has changed the way both robotic and non-robotic telescopes operate, with single isolated telescopes being integrated into expanding smart telescope networks that can span continents and respond to transient events in seconds. At the same time the rise of data warehousing has made data mining more practical, and correlations between new and existing data can be drawn in real time. These changes have led to fundamental shifts in the way astronomers pursue their science. Astronomy, once a data-poor science, has become data-rich.

For many applications it is practical to extend data warehousing to real-time assets such as telescopes. There are few real intrinsic differences between a database and a telescope other than the access time for your data and the time stamps on the data itself. Inside astronomy architectures are emerging which present both static and real-time data resources using the same interface, inherited from a superset of the functionality possessed by both types of resource.

In these architectures all the components of the system, including the software controlling the science programmes, are thought of as agents. A negotiation takes place between these agents in which each of the resources bids to carry out the work, with the science agent scheduling the work with the agent embedded at the resource that promises to return the best result.

Effectively these architectures can be viewed as a general way to co-ordinate distributed (sensor) platforms, preserving inherent platform autonomy, using collective decision making to allocate resources. Such architectures are applicable to many (geographical) distributed sensors problems, or more generally to problems where you must optimise output from a distributed system in the face of scarce resources.

This talk explores the emergence of these architectures in the astronomical community from the viewpoint of one of the people intimately involved in the process. The talk will walk attendees through the pitfalls faced by developers hoping to implement such novel architectures and discuss how the deployment of these architectures in the field has prompted the interesting and increasing use of scientists as mechanical turks by their own software.

About the speaker

This person is speaking at this event.
Alasdair Allan

Scientist, Author, Hacker and Tinkerer

Next session in Sutton South

11:30am Navigating the Data Pipeline by Tim Moreton

Coverage of this session

Sign in to add slides, notes or videos to this session

Tell your friends!

When

Time 10:40am11:20am EST

Date Fri 23rd September 2011

Where

Sutton South, New York Hilton Midtown

Short URL

lanyrd.com/sgywm

View the schedule

Share

Topics

Books by speaker

  • Distributed Network Data
  • Augmented Reality in iOS: Building Apps with Sensors and Computer Vision
  • Learning iOS Programming

See something wrong?

Report an issue with this session