Presentation: In-Motion Analytics Solutions And Platform At IBM
Abstract
Challenges faced, in design, deployment and management of in-motion analytics from high velocity streaming data, are unique and complex. These solutions should deal with ingesting data from variety of sources which may be incompatible or out of sync or produce data at different rate. The chances of failure of data sources or computing elements are very high and implementation should be able to compensate and recover from such failures while still maintaining high throughput and low latency.
We have successfully implemented many streaming analytics solutions for many of our clients using the IBM Streams product. Streams has many features and capabilities required for implementing challenging and advanced real-time analytics solutions. Some of Streams capabilities include application resiliency which ensures at least once processing of tuples, tag- based host deployment which ensures automated quick recovery, windowing capabilities for deduplication, merging and aggregation and use of annotations for parallelization. Streams also has out-of- the-box console for managing and monitoring deployments and also provides JMX extension for integrating with custom management frameworks.
In this presentation, we will go through some common design problems which we encountered in our projects and how they were solved using Streams. We will demonstrate what design and implementation choices you need to anticipate in such projects and common concepts and capabilities which are required in such enterprise solutions and platforms.
Tracks
Monday, 26 June
-
Microservices: Patterns & Practices
Practical experiences and lessons with Microservices.
-
Java - Propelling the Ecosystem Forward
Lessons from Java 8, prepping for Java 9, and looking ahead at Java 10. Innovators in Java.
-
High Velocity Dev Teams
Working Smarter as a team. Improving value delivery of engineers. Lean and Agile principles.
-
Modern Browser-Based Apps
Reactive, cross platform, progressive - webapp tech today.
-
Innovations in Fintech
Technology, tools and techniques supporting modern financial services.
Tuesday, 27 June
-
Architectures You've Always Wondered About
Case studies from the most relevant names in software.
-
Developer Experience: Level up Your Engineering Effectiveness
Trends, tools and projects that we're using to maximally empower your developers.
-
Chaos & Resilience
Failures, edge cases and how we're embracing them.
-
Stream Processing at Large
Rapidly moving data at scale.
-
Building Security Infrastructure
How our industry is being attacked and what you can do about it.
Wednesday, 28 June
-
Next Gen APIs: Designs, Protocols, and Evolution
Practical deep-dives into public and internal API design, tooling and techniques for evolving them, and binary and graph-based protocols.
-
Immutable Infrastructures: Orchestration, Serverless, and More
What's next in infrastructure. How cloud function like lambda are making their way into production.
-
Machine Learning 2.0
Machine Learning 2.0, Deep Learning & Deep Learning Datasets.
-
Modern CS in the Real World
Applied, practical, & real-world dive into industry adoption of modern CS.
-
Optimizing Yourself
Maximizing your impact as an engineer, as a leader, and as a person.
-
Ask Me Anything (AMA)