I am recently working on better indexing concepts(Learned Index-Tensorflow), as part of that, I am curious to know, that how do i generate a index file(Let's say a CSV for now) from A large database, for that i want to generate the Index file(CSV) from the database that changes daily dynamically, I want to update the index file based on the new data that is added in the Database. i.e Generating a index file from the Database.
And after Generating the index file, I will train the model using Tensorflow, as in to get the efficient search results based on the index file.
The approach that i have tried is to make a ordered list and a binary search (or, vice versa, a bst structure, which is even similar to a btree), and recreate it daily.
So i want to know How do i Generate a index file from the Database ?
