Intelligent CIO Africa Issue 14 | Page 78

INTELLIGENT BRANDS // Software for Business The system connects to reputable big data systems and can be deployed flexibly on- edge, on-cluster or in the cloud. Features include the ability to:- • Build adaptable pipelines with minimal coding and maximum flexibility. Users have access to a simplified graphic user interface through which they can build pipelines without the need to hand code, deploy built in transformations and advanced scripting and triggered execution of external code, and rapidly troubleshoot using data injection, snapshot and replay functions. • Operate continuously in the face of constant change. SDC Edge offers zero downtime for upgrades and migration, as well as direct integration with big data governance tools, including Cloudera Navigator and Apache Atlas, and it enables users to manage complex dataflow topologies with StreamSets Dataflow Performance Manager (DPM). • Execute pipelines wherever they are needed. SDC Edge enables flexible deployment in clusters, across multiple clouds, or on edge nodes and devices, allows users to deploy and scale efficiently against Kubernetes, and offers 100% in-memory operation for high throughput and low latency. • Monitor pipeline performance and data quality. SDC Edge pipelines automatically detect and adapt to data drift, the system offers customisable metrics on dataflow operations and data fidelity, and users are privy to early warning of anomalies via data introspection, samples, threshold rules and alerts. ABOUT 9TH BIT CONSULTING 9TH BIT Consulting was established in 2011 in order to assist businesses across Africa to leverage existing IT systems, maximise investments, and ease the transition to current technologies from legacy systems. To achieve this, the company harnesses cutting edge technologies, including DevOps and continuous delivery (CD), big data and data ingestion, as well as the evolving middleware landscape, to relieve growing pressure on the viability and maintenance of older technologies and the applications built upon them. 9TH BIT Consulting is an accredited partner of Sonatype, XebiaLabs, DBmaestro, Red Hat, Oracle, TIBCO, Couchbase, Arcturus Technologies, and StreamSets. The organisation holds a Level One B-BBEE contributor status, and has offices in both Johannesburg and Cape Town. data created by the explosion of digital devices presents an invaluable opportunity for analytics and insight. POWERED BY SDC EDGE ENABLES USERS TO BUILD DATA DRIFT RESISTANT PIPELINES IN A MATTER OF HOURS, THEREBY REDUCING THE COSTS ASSOCIATED WITH LONG LEAD DEVELOPMENTS. “However, harnessing this data for important efforts such as IoT and cybersecurity has been a challenge due to the lack of end-to-end data ingestion frameworks. We built SDC Edge to bring disciplined, well-managed data movement to huge populations of IoT sensors and personal devices so that the promised benefits of these critical initiatives are realised.” n Barry de Waal, Chief Executive of Strategy and Sales at 9TH BIT, said: “Today, moving data reliably and with quality is blocked by the reality of data drift. SDC Edge delivers performance management tools for data flows that feed the next generation of big data applications. This includes the superior management of data in motion, ensuring data arrives in good time, thereby accelerating analysis and simplifying decision making.” Arvind Prabhakar, Co-founder and CTO, StreamSets, said: “The massive volume of 78 INTELLIGENTCIO www.intelligentcio.com