Big Data & IoT
Moore ’ s Law has played its part and increasingly dense processing power is reaching a point of diminishing returns .
Data centre providers need to work smarter , not harder , to avoid being overwhelmed by IoT generated data . Artificial Intelligence ( AI ) and automated systems hold the key to managing the data overload . Removing the human element from data analysis and management allows for much greater speeds and power saving efficiencies . An effectively programmed AI system can reduce the amount of data that has to actually be processed and stored .
It does so by dutifully monitoring all data streams , but only flagging significant variations from the norm ( however this is defined ) for further analysis . This allows the vast majority of data to remain ‘ dormant ’, reducing the processing power required to effectively manage a vast network of connected devices . This filtering step above the initial data collection system expands the capabilities of existing systems to monitor and analyse much larger networks than ever before .
Disruption The Internet of Things is set to cause further disruption in the data centre industry , beyond the already substantial introduction of automated or software defined data centre resource management . A key factor of IoT is that it is populated by smallfactor devices running lightweight software , which can be installed in extremely remote destinations . As networks become increasingly detached , traditional , centralised data centre facilities will be unable to effectively manage and monitor them , resulting in a polarisation of data centre technology .
Smaller ‘ edge ’ data centres will thrive in this new landscape of disconnected network clusters . Demand for processing power can be met as required with easily deployable , modular data centres installed locally . These jumping on / off points for a larger network can provide localised computing power to monitor and process the data generated by the extended network . When it comes to edge data centres , the benefits of the modular approach are multiplied when the technology and capabilities are taken outside of the conventional data centre . Modules were initially designed to function as a miniature , private data centre space within a much larger , high security and well connected facility . As long as suitable conditions can be met , there is no reason that a module can ’ t be set up and installed at any site , to support any connected network , no matter how remote .
These modules further come into their own in settings where it isn ’ t viable to install a conventional , multiacre facility either from a density , power or connectivity perspective . This increasing fragmentation will not spell the end for conventional data centre space . Rather its role will change to that of monitoring an increasingly segmented network .
Data privacy The final element that still threatens to fundamentally polarise the existing data centre network is the debate around data privacy and the newly reinstated Safe Harbor agreement governing data transfer between the EU and the US . Under its new guise as the ‘ Privacy Shield ’, the agreement is set to be adopted in June , but is likely to be subject to legal challenge by EU judicial powers . The physical location of data sensors , storage and processing is increasingly of critical importance . Without implementing specific controls required to meet EU regulations , data back ups to cloud based storage can spread across regional jurisdictions , contravening data privacy laws .
There is increasing pressure for businesses to know exactly where data , generated from specific geographies , is being transferred to , analysed or stored . This pressure further emphasises the importance of a localised network of edge data centres , securely housing , processing and transferring IoT generated data within specific geographical boundaries .
The Internet of Things is set to cause further disruption in the data centre industry .
There ’ s no doubt that IoT will deliver a new ‘ society of data ’. Digitally connecting sensors and devices will transform business and consumer life , by informing data driven decision making and automated processes to reduce costs and provide better services . However , all of this data will need to be handled in a better , smarter way than traditional data centres can currently provide . As a result , we will see a polarisation occur in the data centre industry . Computing power will be devolved from centralised centres to local edge facilities and automation will be embraced as the means of controlling and filtering the ever increasing flow of IoT data .
19