Regarding your last comment around BI in the world of AI is that to get to disruption (which will happen) the systems need more context around the systems themselves and having both access and “knowledge” of the metadata. As an example you can throw a query into ChatGPT and ask it to give you a way to improve it and it will give you some…
Regarding your last comment around BI in the world of AI is that to get to disruption (which will happen) the systems need more context around the systems themselves and having both access and “knowledge” of the metadata. As an example you can throw a query into ChatGPT and ask it to give you a way to improve it and it will give you some useful, but generic info. But now imagine if there was a model that had access to the query logs, size of tables, cardinality, etc and knew what it meant.
More broadly I wonder if we’ll actually start generating different ways in order to make it more accessible to these AI systems.
Yeah I think this is very interesting. More context == better, absolutely. You're talking about more context on the data...I also wonder if there's "more context on the business". And that isn't going to come through metadata. How do you tell a language model that your focus as a business over the coming year is much more on Segment A vs. Segment B, so that every time it looks for insights in a pile of data it keeps that in mind? There are a million facts like that that an experienced data analyst is always bringing to bear.
:shrug: I'm not saying it's impossible, just that it turns out there is a lot of context required to be great at interpreting data.
For sure - and yea I was thinking more about the structure of the tables/relationships/etc vs the business context which to your point is just as important. I do wonder if you can somehow merge the two together - like imagine generating events with some hints that can then be used within the analysis. My limited experience with the ChatGPT-like tools is that they do a pretty good with hints so with your example you'd need to give it some prompts around strategy (prioritize Segment A vs B) and then ask it for the analysis. The open ended question of "give me insight" is the trillion dollar problem though.
Regarding your last comment around BI in the world of AI is that to get to disruption (which will happen) the systems need more context around the systems themselves and having both access and “knowledge” of the metadata. As an example you can throw a query into ChatGPT and ask it to give you a way to improve it and it will give you some useful, but generic info. But now imagine if there was a model that had access to the query logs, size of tables, cardinality, etc and knew what it meant.
More broadly I wonder if we’ll actually start generating different ways in order to make it more accessible to these AI systems.
Yeah I think this is very interesting. More context == better, absolutely. You're talking about more context on the data...I also wonder if there's "more context on the business". And that isn't going to come through metadata. How do you tell a language model that your focus as a business over the coming year is much more on Segment A vs. Segment B, so that every time it looks for insights in a pile of data it keeps that in mind? There are a million facts like that that an experienced data analyst is always bringing to bear.
:shrug: I'm not saying it's impossible, just that it turns out there is a lot of context required to be great at interpreting data.
For sure - and yea I was thinking more about the structure of the tables/relationships/etc vs the business context which to your point is just as important. I do wonder if you can somehow merge the two together - like imagine generating events with some hints that can then be used within the analysis. My limited experience with the ChatGPT-like tools is that they do a pretty good with hints so with your example you'd need to give it some prompts around strategy (prioritize Segment A vs B) and then ask it for the analysis. The open ended question of "give me insight" is the trillion dollar problem though.