6 million Big Data developers were working worldwide by the end of 2017, adding up to a total of $57 billion market of Big Data (of which $18.3 billion are attributed to the Business Intelligence market). Big Data specialists are expecting to see an exponential growth across industries in 2018, both in terms of available technologies and applied use cases.
To get a better understanding of what’s next in the Big Data space, we asked our own Big Data experts at Coforge what they see as the most prominent trends for 2018.
According to Vishwanath Voruganti, Big Data Engineer, Big Data in 2018 would be revolving around the aspects of security and audits for IoT devices. “In 2018, companies will look to implement solutions that will help them secure their data in the most efficient way. To this end, we expect Big Data platforms such as Cloudera, Hortonworks and MapR to introduce new and exciting changes to their platforms.”
Coforge Big Data Engineer, Khyati Sahu, expects to see significant developments in 2 sectors - Healthcare and Retail. According to Khyati, Healthcare Internet of Things (IoT) can offer improved patient care at lower costs, refine the process of monitoring patient behaviour through devices and help in the effective provision of prescriptions. Several healthcare organisations are expected to pilot real-time analytics to identify early warning signs of infections.
For the Retail industry, Khyati believes that we will see an increase in the adoption of IoT applications, with retailers using interactive fitting rooms with smart mirrors, self-checkout scanners and beacons to understand how customers feel about different products and, accordingly, modify their orders, product placement and even send real-time personalised messages and offers.
Vijaya Bhoomireddy, on-site Big Data Architect, goes a little technical while predicting the upcoming trends of 2018. According to him, the focus will be on containerisation where Docker and Kubernetes will play a leading part. As a base processing engine, Spark Core will be the serving layer, while Spark SQL and Spark MLLib will probably give way to more robust SQL and ML libraries.
Big Data Architect, Yasin Mohammed thinks that in 2018 most of the businesses will focus on migrating to hybrid Big Data cloud platforms, involving CEP (Complex Event Processing) and Deep/Active/ Reinforcement Learning, to benefit from more accurate, efficient and fast decision making and problem solving processes.
Kumar Raju Datla, on-site Big Data Engineer, talks about Data Protection and Data Processing as two key upcoming trends for Big Data in 2018. According to him, with the enforcement of GDPR, data needs to be secured and protected at all times, whether in transit or at rest. Because of that, he expects many existing solutions to release updates following enhanced security frameworks. Raju also expects that, especially for data at rest, protection policies such as classification, masking, encoding, encrypting, will gradually become a standard for Big Data platforms.
With respect to Data Processing, Kumar believes that in 2018 a lot of resources will be dedicated in finding ways to achieve ultimate speeds, whilst reducing the costs of processing data with high volume, variety, velocity and/or vulnerability. This need is primarily business driven, and platforms like Spark and Apache Drill are finding increasing acceptance for the achievement of the desired data processing speed at contained costs.
To summarise, Big Data is not expected to slow down any time soon. In 2018 we see Healthcare becoming a prime user of Big Data. Retailers are also becoming more confident in taking advantage of Big Data to transform the way they operate and are expected to start experimenting with IoT. Finally, on the top of CIOs and CTOs agendas to support the increasing business demands will be migrating into the Cloud or a hybrid alternative, data security and data processing.
If you would like to find out more about how Big Data could help you make the most out of your current infrastructure while enabling you to open your digital horizons, do give us a call at +44 (0)203 475 7980 or email us at Salesforce@coforge.com
Other useful links:
Big Data Analytics in the Travel Industry
Your data goldmine - how to capture it, hold it, categorise it and use it
Bright lights, smart city, Big Data