RankFlow plot for retriever visual evaluation

2024-07-08

RAG systems depend on high-quality retrieval to surface relevant information. Analyzing how document rankings evolve through multiple re-ranking steps is complex. This article explores ways to collect ranking data and visualize rank changes to optimize retriever effectiveness.


Continue reading

Open Source LLM Observability Tools and Platforms

2024-02-22

Managing and monitoring the complex behavior of Large Language Models (LLMs) becomes increasingly crucial. LLMOps and LLM Observability provide essential tools for understanding and controlling these models, ensuring their safe and effective deployment. This article delves into the critical aspects of LLM Observability in the realm of generative AI.


Continue reading

Prompt Discovery

2023-11-04

Learn prompt discovery to uncover the most effective prompts and combinations thereof to achieve specific tasks, while also considering factors like response quality, model performance, and computational efficiency


Continue reading

Techniques to Boost RAG Performance in Production

2023-11-01

This article discusses several advanced techniques that can be applied at different stages of the RAG pipeline to enhance its performance in a production setting.


Continue reading

Understanding the Differences in Language Models - Transformers vs. Markov Models

2023-10-07

This article explores distinguishing details of Markov Models and Transformer-based models like GPT, focusing on how they predict the next character in a sequence. It explores the fundamental differences between these models, with a particular emphasis on how the self-attention mechanism in Transformer models makes a difference compared to the fixed context length in Markov models.


Continue reading

How Agile Can Kill Creativity in Data Science team?

2023-09-29

Discover the delicate balance between Agile methodologies and imagination in the domain of data science and analytics. Uncover the impact of Agile approaches on creativity within data science teams. Explore how these practices shape the innovative landscape of data science and analytics.


Continue reading

From Fixed-Size to NLP Chunking - A Deep Dive into Text Chunking Techniques

2023-09-11

Discover text chunking - the secret sauce behind accurate search results and smarter language models! By understanding how to effectively chunk text, we can improve the way we index documents, handle user queries, and utilize search results. Ready to uncover the secrets of text chunking?


Continue reading

Problems with Langchain and how to minimize their impact

2023-09-01

Beyond the Hype - LangChain's Hidden Flaws and How to Master AI Development.


Continue reading

Understanding Retrieval-Augmented Generation (RAG) empowering LLMs

2023-08-24

Understand innovative artificial intelligence framework that empower large language models (LLMs) by anchoring them to external knowledge sources with accurate, current information.


Continue reading

Easy Text Vectorization With VectorHub and Sentence Transformers

2023-07-04

Learn how to use Sentence Transformers for text vectorization with different models using consistent API.


Continue reading

Harnessing the Power of Dependency Injection for Improved Testability in Python

2023-06-21

Learn how to use dependency injection to decouple dependencies from our functions, methods, or classes, making it easier to test and maintain our code.


Continue reading

Efficient Workflow for Reviewing Changes in Git before Pulling from Remote Branch

2023-06-20

  • git
  • workflow Category: note todo: add links

TLDR: Quick Git Command Reference

To quickly review changes before pulling, use this sequence of commands:

# 1. Fetch latest changes without merging
git fetch origin

# 2. See what's different
git log HEAD..origin/main …

Continue reading

The Role and Responsibilities of a Forward Deployed Engineer - Bridging the Gap Between Software Products and Customer Needs

2023-06-09

Bridging the gap between software products and customer needs, Forward Deployed Engineers are the game-changers of enterprise software. Discover their unique role in driving success and why it's in high demand. Don't miss out!


Continue reading

The Best Vector Databases for Storing Embeddings

2023-06-05

Delve into the World of Vector Databases Fueling NLP's Transformative Journey.


Continue reading

Mastering the Kanban Method - Unveiling the Hidden Gems of Effective Kanban Board Usage

2023-05-26

Ever wondered how to supercharge your team's productivity? Say hello to Kanban, the dynamic method that brings clarity and efficiency to your projects.


Continue reading

Attacking Differential Privacy Using the Correlation Between the Features

2023-04-19

Learn how the differential privacy works by simulating attack on data protected with that technique.


Continue reading

Are LIME Explanations Any Useful?

2023-04-18

Don't let black box models hold you back. With LIME, you can interpret the predictions of even the most complex machine learning models.


Continue reading

Intrinsic vs. Extrinsic Evaluation - What's the Best Way to Measure Embedding Quality?

2023-04-18

Learn how to measure the quality of word and sentence embeddings in natural language processing (NLP), including intrinsic and extrinsic evaluation, and their strengths and limitations.


Continue reading

Explaining AI - The Key Differences Between LIME and SHAP Methods

2023-04-14

When it comes to explainable AI, LIME and SHAP are two popular methods for providing insights into the decisions made by machine learning models. What are the key differences between these methods? In this article, we will help you understand which method may be best for your specific use case.


Continue reading

LIME - Understanding How This Method for Explainable AI Works

2023-04-14

Discover how the LIME method can help you understand the important factors behind your model's predictions in a simple, intuitive way.


Continue reading

SHAP - Understanding How This Method for Explainable AI Works

2023-04-14

Discover how the SHAP method can help you understand the important factors behind your model's predictions in a simple, intuitive way.


Continue reading

KernelShap and TreeShap - Two Most Popular Variations of the SHAP Method

2023-04-14

Making sense of AI's inner workings with KernelShap and TreeShap the powerfull tools for responsible AI.


Continue reading

LIME Tutorial

2023-04-14

Unveiling the mysteries of AI decisions? Let us dive into LIME, the tool that sheds light on the black box.


Continue reading

Zero-Knowledge Explained Like to 5 Years Old

2023-04-06

Imagine being able to prove something without actually revealing it. That is the power of zero-knowledge proofs, the technology that keeps your crypto safe.


Continue reading

Rethinking the Link Between Speech and Expertise

2023-02-23

We often associate eloquent speech with intelligence and knowledge. But what if I told you that this assumption is not always true?


Continue reading

Understanding AI with ELI5 - Demystifying Decisions (tutorial)

2023-02-20

Want to know why your AI model made that decision? ELI5 has got you covered. Let's dive into Explainable AI with ELI5.


Continue reading

A Guide to Building a Python RPC Server Using Flask

2023-02-13

Discover the world of distributed systems and build your own Python RPC server using Flask. Harness the power of remote procedure calls today!


Continue reading

How to Use RPC in Python?

2023-02-13

Get Started with RPC - A Beginner's Guide to Building a Python RPC Server Using xmlrpc and jsonrpc.


Continue reading

"Comprehensive Guide to Interpreting R\xB2, MSE, and RMSE for Regression Models."

2023-02-13

Don't let misleading metrics fool you. Master the art of analyzing regression model performance and make smarter decisions.


Continue reading

Beyond Airflow - 10 Workflow Tools You Need to Know

2023-02-12

Looking for a new workflow management tool? Do not settle for Apache Airflow just because it is popular. Discover 10 cutting-edge alternatives that could be a better fit for your needs.


Continue reading

Libraries for Automated Exploratory Data Analysis (EDA)

2023-02-12

EDA Made Easy - Discover Top-10 Python Libraries That Will Take Your Data Analysis to the Next Level! Learn the Secrets of Automated EDA!


Continue reading

Is the the Game Theory Any Useful for Data Science?

2023-02-09

Exploring the intersection of game theory and data science - insights into decision-making, network behavior, and optimization algorithms.


Continue reading

Beat Overfitting in Kaggle Competitions - Proven Techniques

2023-02-08

Ready to take your Kaggle competition game to the next level? Learn how to recognize and prevent overfitting for top-notch results.


Continue reading

New Cognitive Skills in the Age of AI Tailored Information Presentation

2023-02-02

Exploring the new cognitive skills of tomorrow with advanced AI generative models.


Continue reading

The Impact of Search Engines and AI Generative Models on Mental and Cognitive Capabilities

2023-02-01

Understand the effects of search engines and AI on our mental and cognitive capabilities. Equip yourself with the knowledge you need to make informed decisions about your own usage of these technologies.


Continue reading

Leveraging Language Models in Corporate Environments - The Future of Knowledge Management

2023-02-01

Explore the benefits and challenges of using Large Language Models (LLMs) in corporate environments for improved knowledge management. Learn how to implement LLMs and overcome potential obstacles.


Continue reading

Top Popular ZSH Plugins on GitHub (2023)

2023-01-30

Explore the most popular Zsh plugins from the 2000+ options on the Awesome Zsh plugins GitHub project. See which ones have the highest number of stars from the Zsh community.


Continue reading

Becoming a Data Wizard - The Benefits of Learning Databricks

2023-01-30

Learn how Databricks can help you master big data, improve data processing and machine learning skills and excel in your career. Boost your career with this powerful platform.


Continue reading

Policies in MLOps

2023-01-25

Discover the secrets to successful MLOps - From planning to deployment, get a comprehensive guide to ML policies.


Continue reading

MLOps Scorecard - How Advanced Is Your Organization in Implementing MLOps Processes?

2023-01-21

Use proposed scorecard to assess how advanced is your organization in implementing MLOps processes.


Continue reading

Common Types of Data Science Projects

2023-01-19

Learn about common types of data science projects and best practices for approaching them. From end-to-end individual work to production-ready projects, this guide covers it all.


Continue reading

Don't Just Create Backups, Verify Them - How Restic Can Help?

2023-01-15

Learn how to verify your backups with Restic, ensure completeness, integrity, and recoverability. Automate the process for peace of mind. Read now


Continue reading