Resources

Intro to Large Language Models

A general-audience overview of how LLMs are trained and the key concepts behind their operation, including pre-training, fine-tuning, and RLHF.

Let's build GPT: from scratch, in code, spelled out

A deep, code-first dive into the Transformer architecture that powers models like GPT.

LLM Course on GitHub

A comprehensive course covering LLM fundamentals, the science of building LLMs, and the engineering of LLM-based applications.

RDKit

RDKit is a collection of cheminformatics and machine-learning software written in C++ and Python.

Official Documentation: The "Getting Started with the RDKit in Python" guide is the best place to begin.

YouTube Tutorial: Video tutorial by Jan Jensen is another great resource to start with.

PySCF

The Python-based Simulations of Chemistry Framework (PySCF) is an open-source library for quantum chemistry calculations. It is highly extensible and designed for simplicity, both for users and developers.

Official Documentation: The 'User Guide' and 'Tutorials' are great starting points.

Atomic Simulation Environment (ASE)

The Atomic Simulation Environment (ASE) is a set of tools and Python modules for setting up, manipulating, running, visualizing and analyzing atomistic simulations.

Official Documentation: The 'ASE Tutorials' is the best place to begin with.

Pymatgen

Pymatgen (Python Materials Genomics) is a robust, open-source Python library for materials analysis.

Official Documentation: The pymatgen API Documentation is the best place to begin with.

YouTube Tutorial: Video tutorial by Anubhav Jain, developer of pymatgen, is another great resource to start with.

LangChain

LangChain is an open-source library specifically designed for creating applications using large language models (LLMs).

Official Documentation: The best place to begin is the official LangChain documentation. It offers a comprehensive overview of the framework, from installation to advanced use cases.

YouTube Tutorial: For visual learners, aiwithbrandon YouTube channel provides a wealth of tutorials. The "LangChain Master Class For Beginners 2024" video is an excellent starting point.

LangGraph

LangGraph, created by LangChain, is an open source AI agent framework designed to build, deploy and manage complex generative AI agent workflows.

Official Documentation: To dive into building stateful, multi-actor applications, the LangGraph documentation is your go-to resource.

YouTube Tutorial: A great video tutorial by LangChain on "Building Effective Agents with LangGraph" provides a practical introduction to creating sophisticated agents.

Fine-Tuning LLMs

Fine-tuning allows you to adapt pre-trained models to specific tasks or domains, making them more effective for specialized applications in materials science and chemistry.

Retrieval-Augmented Generation (RAG)

RAG combines the power of retrieval systems with language generation, allowing LLMs to access and use external knowledge bases effectively.

Prompt Engineering

Learn how to craft effective prompts to get the best results from language models in scientific applications.

Materials Science Datasets Compilation

A curated list of awesome materials and chemistry datasets by Ben Blaiszik.

arXiv Preprints

The entire collection of preprints from arXiv is available for bulk download, providing a massive corpus for text mining the latest scientific research.

Hugging Face Datasets

A central hub for thousands of datasets, including a growing number for materials science and chemistry.

Kaggle Datasets

A platform hosting a wide variety of public datasets, including many relevant to chemistry and materials science.

Reflections from the 2024 Large Language Model (LLM) Hackathon for Applications in Materials Science and Chemistry

In the 2nd global hackathon for LLMs applications for materials and chemistry 34 teams used large language models to create applications for materials science and chemistry research across seven different areas like property prediction, molecular design, and scientific communication.

14 examples of how LLMs can transform materials science and chemistry: a reflection on a large language model hackathon

In the 1st global hackathon for LLMs applications for materials and chemistry participants used large language models like GPT-4 to build working prototypes for chemistry and materials science applications in just two days.

A Survey of AI for Materials Science: Foundation Models, LLM Agents, Datasets, and Tools

A comprehensive review on how large AI foundation models (like ChatGPT-style systems) are being used to accelerate materials science research across six key areas from data analysis to discovering new materials.

A review of large language models and autonomous agents in chemistry

The authors reviewed how large language models and AI agents are being used in chemistry for tasks like molecule design and laboratory automation, and created a repository to track ongoing research in this rapidly evolving field.