Generative AI: Integrate openAI API with Python

I was fortunate to follow the course of Sven Warris about software tools to integrate genAI into your own work and applications. The course is aimed at data scientists and bioinformaticians.

Introduction

• Artificial Intelligence (AI): Technology aimed at mimicking human abilities like reasoning, learning, problem-solving, and perception.
  • Machine Learning (ML): Uses algorithms and statistical models to execute tasks based on pattern recognition and inference, without explicit instructions.
  • Statistics: The foundational science for analyzing and interpreting data, essential for AI development.
  • Deep Learning (DL): A subset of ML that utilizes layered neural networks, excelling in complex tasks such as speech and image recognition.
  • Generative AI: Focuses on creating new content (e.g., images, texts, sounds) from trained data, emphasizing the versatility in output types.

Process of Tokenizing and Embedding

• Tokenization: Breaking down text into smaller units called tokens e.g. words.
• Embedding: Converts tokens into numerical vectors that represent both the literal and contextual meanings of the tokens. This process is critical for machine understanding and manipulation of language.

Applications and Developments in Generative AI

• Prompt Engineering: Often referred to as prompt hacking, it involves crafting queries that guide AI to produce desired outcomes. Used in various applications from grant proposals to blog posts and image generation.
• Data Analytics and Application Integration: LLMs can be integrated with APIs like OpenWeather for real-time data processing and activity suggestions based on weather conditions.
• Automated Document Processing: Tools like Langchain and ChatGPT can process and generate structured outputs from documents such as scientific papers.

Prompt engineering using the ChatGPT web interface

The OpenAI API

text

Data analytics

Retrieval Augmented Generation (RAG)

Image generation and processing through the API

Langchain and large documents

References

• Generative AI workshop: Sven Warris doc

https://www.planeks.net/open-ai-api-integration-guide/

Published on May 27, 2024

---

Relevant Tags

• data-science 
• tech 

About the Author

Pierre-Edouard Guerin

Bioinformatician

Latest Articles

• Turing Complete: From Logical Gates to CPU Architecture

  In 2021, LevelHead published Turing Complete, a game about computer science. My friend Christophe Georgescu recommended me to play it. Unfortunately, I took his advice and now I can not stop to play this game! The game challenges you to design an entire computer from scratch. You start with basic logic gates, then move on to components, memory, CPU architecture, and finally assembly programming. By the way, the game is neat and present all these concepts in a playful and intuitive way.
  SEP 2025 · PIERRE-EDOUARD GUERIN

• How to Manage a Project?

  In any company, every task is part of a project. I am responsible for managing multiple projects each year. I have to present deliverables to stakeholders, meet deadlines, allocate mandays and coordinate everyone’s actions. This is a meticulous work that requires a strong methodology.
  JUN 2025 · PIERRE-EDOUARD GUERIN

• Gantt Chart Excel for Project Management

  A Gantt chart visualizes the scheduling of tasks over the project timeline. My colleague Daphne Verdelet shared with me the Excel template her team at INRAE uses to keep track of their tasks over the year.
  MAY 2025 · PIERRE-EDOUARD GUERIN

See all >