What We’ve Coated
All through the One Large Cluster Caught collection we’ve explored impactful finest practices to achieve management of your Cloudera Knowledge platform (CDP) atmosphere and considerably enhance its well being and efficiency. We’ve shared code, dashboards, and instruments that will help you in your well being enchancment journey. We’d like to offer one final software.
The Environmental Well being Scorecard
We monitor atmosphere well being on the macro stage with a dashboard that mirrors our weblog collection methodology with just a few additions. We set quarterly OKR (Targets and Key Outcomes) targets to enhance our rating.
At decrease ranges of grain our measurements are data-driven and automatic, however on the macro stage we favor to use some subjectivity (after all our weightings will differ from yours as we’re on a unique journey). Our knowledge and analytics leaders meet month-to-month to guage our well being enchancment and log subjective measures. Some could name that anecdotal proof however we worth the pairing of our data-driven evaluation with our observable actuality.
Platform Well being
All of it begins with platform well being which we selected to measure in 3 dimensions: {hardware} efficiency, companies efficiency, and optimum configuration/tuning. We offered dozens of how-to manuals to acquire visibility and tune your atmosphere.
Is it stunning that we weighted platform well being solely an 8 on a 100 level scale? Our mannequin considers the period and useful resource dedication required to finish 80% of the journey, and since our platform optimization took just a few assets just a few months, we weighted it low. If you happen to’ve acquired a multiyear platform journey forward of you, you’ll weigh it extra closely.
NOTE: The Optimally configured quantity is only a rely of tunings we accomplished, and the chances are subjective evaluations.
Visibility and Transparency
Weighted a 20?! Yup. It’s that vital to us as we now have written. We selected separate measures for our personal jobs and our customers’ jobs. With 100% monitoring, alerting (notifications to DevOps), and notifications (to our clients), why didn’t we earn a 20? As a result of we weren’t as proactive in resolving points as our OKR targets indicated we must be.
Knowledge Democratization
Though we didn’t weblog about knowledge democratization, we discover it an vital measure of environmental well being. Each different measurement is meaningless if vital knowledge parts are unavailable to determination makers. By the way, this measure is within the reverse seat of the see-saw because the others: ungoverned knowledge democratization is the only biggest reason behind all the issues we’re making an attempt to influence. Take into consideration that.
Knowledge Course of Well being
Though we didn’t commit a weblog to this well being measure, we offered quite a few directions to restore issues you discover. The objectives we selected within the dashboard are vital to us, however select these which might be vital to you. The person scores are counts however the total well being rating will not be a sum, it’s subjective. This can be a multiyear journey.
Knowledge Asset Standardization
This measure will get our highest weighting at 25 out of 100. The well being of the atmosphere is most depending on the belief that customers have within the knowledge. The higher your knowledge observability, and the higher the quantity that’s accessed through enterprise customary dashboards and governance-certified sources of reality, the higher the chance for belief. The belief develops via an understanding of the information as maintained via metadata in your Knowledge Catalog: classification, lineage, foreign money, and enterprise context . You’ll be able to see that we did nice on report standardization however we now have longer to go to certify our enriched datasets and knowledge marts, and to repipe our customers’ belongings. One other multiyear journey.
Knowledge High quality & Knowledge Governance Extensibility
Like knowledge standardization this goes to the center of trusted knowledge. We’ve 37 whole well being factors measuring knowledge trustworthiness. Which will appear counterintuitive when utilized to an environmental “well being” measure, however that’s how we see it. You may even see these and different measures in a different way.
Better of Luck!
We smile on the chance that we would have enabled you to be extra environment friendly or succesful (or each!). Go to our Group Web page, our blogs, and Knowledge and IT Leaders web page for a lot extra.
