PinnedPradeep BansalHow to do named entity recognition for languages other than English?A language model (LM), whether to predict the next word in a sequence or to predict entities or tags in a sequence are related to a…Aug 1, 2023Aug 1, 2023
PinnedPradeep BansalLearning Transformers via Question and AnswerBehind all the GPT-x and other Large Language Models (LLMs), there’s only one thing that is common between all these LLMs and is also the…Jun 4, 2023Jun 4, 2023
PinnedPradeep BansalinArtificial Intelligence in Plain EnglishWhy your Machine Learning model may not work in production ?Most of the machine learning models never go to production but its worse when the models in production become worthless pretty soon. This…Apr 14, 2020Apr 14, 2020
PinnedPradeep BansalinArtificial Intelligence in Plain EnglishHow to structure our machine learning projects ?We are all familiar with the following steps for any Machine Learning project —EDA, Data cleaning, Feature engineering, model selection…Apr 26, 2020Apr 26, 2020
PinnedPradeep BansalScaling the kafka consumer for a machine learning service in pythonThe Set UpJul 7, 2021Jul 7, 2021
Pradeep BansalLLM Hallucination Detection: Background with latest techniquesOne major hurdle in adopting AI for real life scenario is its inability to be accurate every time. There was a sudden “hope” with the…Jun 11Jun 11
Pradeep BansalLLM Hallucination Detection: Can LLM-Generated Knowledge Graphs Be Trusted?An LLM response can be hallucinated which means it can be factually incorrect or inconsistent w.r.t. the reference document. For eg. while…Jun 10Jun 10
Pradeep BansalFine-Tuning a pre-trained LLM with unlabelled datasetA generic LLM or an LLM pre-trained on the dataset different from the domain of the final task has to be fine-tuned to the task specific…Oct 1, 2023Oct 1, 2023
Pradeep BansalHow do you use BERT as a classifier without fine-tuning?BERT, Bidirectional Encoder Representations from Transformers, is the deep learning model quite famous for generating embeddings that are…Sep 27, 2023Sep 27, 2023
Pradeep BansalCommon questions while using the Hugging Face’s transformers library.Instead of writing one complete blog on topics like summarization or text generation, I thought of taking most important topics involved…Aug 7, 2023Aug 7, 2023