Forum Discussion
The Learning Engineer is DEAD? Long LIVE! the Learning Engineer?
It's likely that you could use AI to write whatever python code you need.
I couldn't tell from your post if you had specific things you were hoping to learn from your datasets. I would think that is a more important focus area at the beginning. Once you know what you're trying to learn from the data, then you can search for the best way to mine the data to get those answers.
You'll want to be careful about how you leverage AI. Something like Chat-GPT with Code Interpreter will be a lot more reliable than Chat-GPT without Code Interpreter when it comes to summarizing findings from the data. There is still a serious problem with "hallucination" (the term for when the AI system just makes stuff up and confidently presents it as fact) that you will need to be alert to. Chatbots also have some basic weaknesses (for example, counting) that could also have a big impact on the reliability of their analyses.