All posts
How to build a Personality Analytics engine
Author
Uri Ort
Created on
July 11, 2023

For a few months now we’ve been working hard to add Personality Analytics to the Deeper Signals platform. Designing and building an analytics engine is a significant undertaking. It required re-thinking our data architecture, cleaning up old code, and a lot of work and rework on the user-interface. As we close in on the finish line, I thought I’d share a bit about the process and what the final product will (hopefully) look like. 

The most important question was why. The scope of this project and the investment it would require made us second-guess ourselves throughout the planning process. Would it really provide value to our clients? What’s the ROI? Ultimately the answer was simple. Deeper Signals assessments are unique in that we enable organizations to offer self- and other- awareness to the entire organization. If leaders have access to accurate psychological data across their entire workforce, their ability to predict and understand performance is unparalleled.

We already knew our clients are using Core Drivers data this way by exporting it to existing Insights & Analytics solutions. Adding that capability to our own platform would be a clear differentiator. It also allows us to structure the data and visualizations in a way that makes it easy to add a new layer of insight into the critical questions organizations are always asking, such as, “what’s driving attrition?”, “why are these teams more engaged than other teams?”, and “why are some leaders more successful than others?”

Next we considered our current data structure. Integrating HRIS data required adding many more fields to our existing indexes. This led to an analysis of the data we currently store in Elastic, the structure of that data, and we even considered migrating all of our data to a data warehouse such as Snowflake or Redshift. Our data team spent countless hours researching the pros and cons and speaking to experts on Big Data, AI and Elastic Search. We needed to balance time, cost and future roadmap requirements. It was a hard call, but ultimately, we opted to stick with Elastic (for now) and to restructure how the data is stored and to move out some older data that never really belonged in Elastic in the first place. 

Planning the UI brought us to the age-old buy or build question. There are a number of embeddable and SDK graphing and charting packages we could have used to speed up the project. Google’s Looker is the premium product in this space, but RevealBI or High Charts are affordable and would also be sufficient. Buying would save us heaps of time and guarantee a feature rich product. Some options even offer machine-learning models out of the box, which is a feature on our roadmap. However, the downside of buying were also obvious. For one, the cost of these packages range from $10k – $100k, annually.  More importantly, once users start creating their own visualizations it would be a nightmare to migrate to our own engine down the line. Ultimately, we decided to build. But anyone who has faced the buy or build question knows it never really goes away. It’s always there to remind you that you could have gone the other way, especially late at night when you can’t seem to remember why you started the project in the first place. 

Global charts, Assessment charts, or Project charts? As we build out the UI these are the questions we are still answering. On the one hand it would be fabulous to create graphs across different assessments or projects in one dashboard. On the other hand, we know users share access to dashboards and want to restrict data to specific assessments or projects. We also didn’t want to lose the existing default charts that load with every Core Drivers assessment. Which means we need to have default charts and editable charts. Do these go on the same dashboards or different dashboards? When we launch, we’ll have drag-and-drop chart builders for Assessments and Projects. Later on, we’ll add a global charting dashboard for specific clients. We’re still figuring out the default charts functionality.  

So when is it coming out? It’ll take another two weeks to write all of the backend code and finish the Elastic restructuring. At that point our frontend team should be done with the general design refresh (a story for another time) and we can focus 100% of our energy on the Personality Analytics frontend. That should take another 2-3 weeks. So hopefully by the second week of September we should be ready for prime time. Here’s a sneak peek of where we’re up to with the design. 


I know we’ve been quiet on the feature front for some time, but we're confident it will be well worth the wait. Looking back at writing this blog, it sure seems a lot simpler than it felt going through it, but trust me, it was a lot of work. Hopefully this gives you some insight into what we’ve been up to. If you have questions or suggestions, don’t hesitate to reach out to me

Recent posts
Guides & Tips
How to build a cognitively diverse team
These four key tips to building a cognitively diverse team provide actionable strategies for coaches and leaders. Find out how to use cognitive diversity to create successful teams.
Read more
Articles
Deciphering Cognitive Diversity: A Guide to Unleashing Team Brilliance
Ever wondered which factors truly impact startup success? In this blog post we guide you through how the personalities of founders and the cognitive diversity of teams impact success.
Read more
News & Press
Two key milestones in data security achieved: SOC 2 Type 2 re–attestation and GDPR compliance
We have created further benefits for our coach and enterprise customers with these achievements. Attained through a rigorous external audit, SOC 2 Type 2 attestation and GDPR compliance are crucial during a time where safeguarding data is essential.
Read more
Articles
Decoding Startup Success: The Impact of Personalities on Venture Viability
Ever wondered which factors truly impact startup success? In our latest blog post we make the case for personalities. The personalities of founders make the most significant difference, find out how.
Read more
News & Press
Introducing a fresh new look and feel for the Deeper Signals Platform!
2024 is all about usability. This year we are committed to providing an even more intuitive and coherent experience with Deeper Signals. We are excited to introduce the first of a series of updates focused on user experience and improved functionality.
Read more
Curious to learn more?

Schedule a call with Deeper Signals to understand how our assessments and feedback tools help people gain a deep awareness of their talents and reach their full potential. Underpinned by science and technology, we build talented people, leaders and companies.

  • Scalable and engaging assessment solutions
  • Measurable and predictive talent insights
  • Powered by technology and science that drives results
Let's talk!
  • Scalable interventions for growth
  • Measureable data, insights and outcomes for high performance
  • Proven scientific expertise that links results to outcomes
Thank you! Your submission has been received!
Please fill all fields before submiting the form.