1st Generation 2nd Generation
Capacity Increase
Order new nodes , install in data center , installation of operating systems and platform software .
Autoscaling , no human involvement necessary .
Version Upgrade
Use of vendor tools to schedule roll outs to multiple systems , working to ensure capacity stays at a minimum to support user needs .
Depending on service type upgrades can be transparent , or as simple as a restart of the service to get the latest release .
Authentication & Authorization
Complex integration with LDAP , Active Directory or other on-premise AAA platforms .
Seamless integration with cloud vendor IAM platforms for use of simplified identified and access policies across services .
User Demand for New Capability
Administrators required to verify compatibility of new service with existing tools , and schedule a deployment .
Users are able to consume cloud platform services without the involvement of operations teams to test new capabilities .
Figure 1 - Simplification of Operations Through Cloud Native Services
will be focused on resolving those and aligning the data with the business needs , not the operational aspects of deploying services and maintaining stability of the platform .
Cloud vendors provided two primary models for big data services :
Managed – Services like AWS Elastic Map Reduce ( EMR ) run on instances , but also provide pre-package OS images with all the necessary software tested and integrated . Managed services provide a level of flexibility because admins and users can still get to the host operating system to manage some configurations , but have the advantage of upgrades being handled by the platform vendors . Managed services provide a minimal level of interaction and configuration , allowing operations teams and analysts deeper visibility into the platform . In highly regulated environments this can often provide the necessary level of visibility .
PaaS – Platform as a Service offerings , such as BigQuery from Google , provide an interface for users to connect to and submit queries , with no need for the user to take on administrative functionality . There is no ability to login to the instances running the services and no user visibility into the inner workings of the service as it relates to scalability and reliability . PaaS services offer a valuable balance of service capability without the need to have operations teams focused on service deployment and operations . PaaS services provide no visibility into the inner workings of the service , all aspects of scalability , data movement and upgrades are handled by the provider , allowing users to focus entirely on consuming the service , and not operating the service . This level of abstraction is very valuable for companies with small or no operations teams .
58 | THE DOPPLER | WINTER 2017