AI model - codesphere

codesphere

Sign in Subscribe

AI model

A collection of 6 posts

Structure PDF Table Data for AI Applications with GMFT

Structure PDF Table Data for AI Applications with GMFT

GMFT is a fast, lightweight toolkit for extracting tables from PDFs into formats like CSV, JSON, and Pandas DataFrames. Leveraging Microsoft's Table Transformer, GMFT efficiently processes both text and image tables, ensuring high performance for reliable data extraction.

Extracting Metadata from PDFs with Named Entity Recognition using Spacy

Extracting Metadata from PDFs with Named Entity Recognition using Spacy

NER identifies entities like people and locations in text. SpaCy automates this with pre-trained models, offering accuracy, speed, and multi-language support. It excels at handling large datasets efficiently compared to rule-based methods.

Llama 3.1 context window

Taking Advantage of the Long Context of Llama 3.1

Llama 3.1 allows a context window of 128k tokens. We investigate how to take advantage of this long context of Llama without running into performance issues.

Document classification

Best sub 7b AI model for categorizing documents in August 2024

Documents classification can be achieved by using a fine-tuned discriminative model or doing some prompt engineering and using a generative model for the task.

Pictoral representation of how tea and coffee are semantically closer to each other

Best Open Source Sentence Embedding Models in August 2024

Sentence embedding models capture the overall semantic meaning of the text. We tested and compiled the best-performing open-source models for you.

Build your own VS Code extension

Build your own VS Code extension

This blogpost is everything you need to get started with building your very own VS Code extension.