Big Data Integration & Governance – Leveraging Your Existing Technology
In September 2013, IBM announced exciting innovations in Information Integration & Governance (IIG) that represented an evolution of these products for the new era of computing – big data, cloud, mobile, and social. The key point was evolution – because this product line was designed from its onset to handle large volumes, was built to be modular and therefore accommodate new components and technologies, it was able to adapt to new big data requirements and adopt new big data technologies with ease. Fortunately the product set was already designed to handle the key requirements of big data – massive scalability and parallel processing.
Some of the key things IBM announced were agile integration and governance, confidence in big data, and automated integration. It’s been six months since those announcements, and these capabilities are really taking hold in the market.
First let’s examine data confidence. This has really become a top market issue in the past year. Numerous companies that I’ve met with are more concerned with measuring confidence in data, and improving confidence in data for their big data & analytics projects. The rise of the Chief Data Officer (CDO) gives evidence to this point – companies are charging CDOs with understanding and improving data so it may be utilized, and trusted, for analytics. There are numerous press articles highlighting the importance of “confidence” and “metadata” and “lineage” with respect to big data projects. Here’s one such article that appeared in Forbes – http://onforb.es/1hU1VOt. But most importantly, clients are making this part of their big data projects – I’ve seen a noticeable shift in terms of utilizing metadata and lineage to approximate confidence levels in big data.
IBM also announced advancements in automated integration, a capability it was the first to champion as ‘the next frontier for data integration’. The hypothesis was simple – in the era of big data, you’ll have more sources and more repositories for specialized analytic workloads, therefore you’ll have more integration, so it should be made simple. And that’s exactly what has played out in the market. Companies have adopted IBM’s Data Click to speed integration between big data sources and targets, and to offer business department ‘self-service’ to access big data. This has proven extremely valuable, as more companies look to centralize big data in a ‘data lake’, and technical users in business departments want access to that data to bring into their own repositories for ad hoc analysis.
And IBM’s capabilities in Agile Governance have received a warm reception from the market. The ability to apply appropriate levels of governance at different points in time is the key to quickly, yet safely, harnessing the power of big data. Many organizations have adopted IBM’s agile data security capabilities to monitor, mask and protect sensitive big data.
IBM’s Information Integration & Governance portfolio is the market leader in Information Governance, and it was designed from the beginning to handle the biggest and most complex requirements. That original design placed it in a fortunate position – it was already ready for the era of big data in terms of performance and scalability, and simply had to adapt for newer requirements such as variety, and new technologies such as Hadoop and NoSQL. So while competitors have played catch up and have reinvented their portfolio for big data, IBM has invested to move forward. Be on the lookout for some exciting new innovations in IIG in 2014.
For more information, go to IBM Big Data Hub.
About David CorriganI’ve spent my entire career helping clients utilize emerging technology to solve their customer data problems. I've always enjoyed solving abstract problems. I've worked with hundreds of companies to utilize new technology, plan and drive to a roadmap, and evangelize and drive momentum for their information projects. During the day, I work on product strategy and marketing for @InfoTrellis, and I'm busy trying to disrupt the customer data and analytics market so that organizations can finally understand every single one of their customers. After hours, I like to take photographs, read, write, practice yoga, or watch soccer - Manchester United and Toronto FC are my teams of choice. Follow me on Twitter @DCorrigan or on LinkedIn at http://ca.linkedin.com/pub/david-corrigan/3/aa3/92.
- 360 view
- Big Data
- customer 360
- Customer big data
- Customer context matching
- Customer data
- customer intelligence management
- customer personalization
- Data Confidence
- Data Quality
- Data Warehousing
- Hadoop Systems & Analytics
- Information Governance
- Information Integration
- Information Lifecycle Management
- Master Data Management
- omnichannel personalization
- Privacy and Security
- Stream Computing
- Visual Context for Data
- Interesting read, & I've seen AI applied to form an identity graph for customers/prospects for better targeting.… twitter.com/i/web/status/1… 3 weeks ago
- Good read, and aligns with other stats that suggest that 67% of customers will churn after 1 bad experience - even… twitter.com/i/web/status/1… 3 weeks ago
- An interesting but also troubling read. There's huge upside to automation in industries like insurance, not to men… twitter.com/i/web/status/1… 1 month ago
- Have to retweet & elaborate - #graphbd is a great technology but the queries can be intense - part of the value of… twitter.com/i/web/status/1… 1 month ago
- RT @AllSight: "By putting intelligence before insight, you have the right context to get the right answers." - @DCorrigan #CIP #BigData #Da… 1 month ago