OpenLM is an open-source language modeling repository that focuses on medium-sized models, designed to enhance research accessibility and GPU efficiency. It supports fast training and is adaptable for novel AI research and applications, embodying a philosophy of transparency and collaborative innovation. OpenLM tokenizes its model via an Initial Model Offering on Ethereum, promoting decentralization and the democratization of AI technology. This approach supports the belief that knowledge should be open, shared freely, and benefit the global community, thus fostering rapid advancements in AI.