Concepts

Predictive analysis

Descriptive analysis

Semantic Search

• Not searching using exact key word matching but Understanding the intent of user search and using context to perform the search .
• Google uses concept of embedding. It is nothing but numerical representation of text
• Generate Embeddings using openai API, save in sql db
• When there is search query, generate embeddings for the same and compare with stored embedding using Cosine similarity.
• 
  

imputation

• Impute so that the normal distribution doesn't change. KNN is one sol instead of mean/median/mode for number columns

Apps

• Delhivery

Vector Embedding

• Technique to represent information in format that can be easily processed by algorithms esp deep learning programs.
• Word/Text Embedding
• Document Embedding
• Sentence Embedding
• Graph Embedding
• Image Embedding