The data field is changing. People in the industry feel it. It’s an exciting time, but difficult to explain exactly why. Several people have shared their takes, but no one seems to fully capture what our profession is experiencing today.
Is this momentum coming from another rebranding of data - destined to fall out of favor in a few years?
Perhaps it is the formation of an intergalactic data stack - finally settling into distinguishable bodies that enable us to do great work.
There is truth in all these articles, but not the whole truth. Individually they give us a unique perspective into the current state of analytics. Woven together, you can start to see the larger narrative. That narrative is like one big book. A book that is still being written. A book that is open for your contribution.
This idea clicked with me when I observed a thread between Emily Hawkins and Jason Ganz on Twitter. Emily is running a dbt bootcamp and Jason will be a special guest during the course. During their exchange of mutual respect and appreciation, Jason hit on a deeper truth.
Just to double down on the point, because it’s so important, “The fun thing about analytics engineering is it’s a discipline we’re all collaboratively building together.”
No company owns the definition for an Analytics Engineer. There is no certification handed down from a board of experts before a data professional can start practicing their craft. Yet, a vibrant community has formed around analytic work, welcoming your ideas, and weaving them into the larger narrative.
Not Boring’s Packy McCormick identified this trend of bottoms-up narrative building in his piece - Story Time. Each individual story may stand on its own, but when you bring them together they form a narrative with direction, size, and tone. Once that narrative forms it compounds with the Lindy Effect - the longer it lasts, the longer it’s expected to last.
I believe the energy we are collectively feeling is coming from our compounding narrative. It started with the launch of Redshift in 2012 and continues to build momentum as the modern data experience matures.
To unlock this compounding effect Packy highlights some keys to success. I have not found another data-centric community that has embraced these keys as well as the dbt community. It’s worth a quick case study.
This shift in analytics is larger than any individual company though. It is an open book, waiting for you to write the next chapter, paragraph, or query.
I encourage you to share your stories.
Whether you share a celebration from your work, patiently answer a newcomer’s question, or publish a thought piece you’re worried you have no earthly qualification to write - I encourage you to share your stories!
Each bit of work put out into the community helps shape what we are all collaboratively building together. Let’s keep it rolling.