Dave Maier -- Benchmark Brainstroming
Discussion
- An interesting property for a DSMS is overhead for fault tolerance (e.g. recovery time), since these systems are 24X7
- Has burstiness and variability been added to NEXMark? Answer: yes
- Isn't talk of developing benchmarks premature, since we do not have a concensus on the interesting applications yet?
Two responses: (1) Get it done early to get early feedback
(2) At the last Stream meeting, an early draft of NEXMark generated a very lively discussion
Mike Stonebraker -- ???
Jennifer Widom's clarification of the exploits
- Time Series means using various kinds of windows
- Complex scenarios require developers to use multiple applications, which means more context switching
- ACID means we can take advantage of QoS - specifically, load shedding
Domains that might hit our exploits:
- Medical Monitoring
- Traffic Management, incl. personalized output
- Fraud Detection
- US Squirrels Corp
- FinTime
- Network Management
- Online Auction
Discussion
- FinTime may be a good app to look into. It measures financial time series data
response: Oracle has time-series extensions, and they are going into DB2, so we lose one of our exploits
- I really want sharing as an exploit
- Can we legally compare ourselves to Oracle?
response: We can compare to SleepyCat publicly, then also say we compared similarly to other products
- We will need the assistance of a domain expert in defining each of these domains
- What about click-stream analysis?
response: There are already many specialty apps available that we won't be able to beat
- What about air-traffic control domain?
response: we'll need a domain expert to help us see if that addresses the exploits (Maybe Dave Gifford?)
- We won't be able to use a live stream benchmark. We'll want traces or simulations
Action items
- Define and implement a benchmark in three months
- Volunteers by next Friday (1/17)
- Shasha will check on the finance domain
- Must get more information on the domains we do not understand