.. cz-benchmarks documentation master file, created by sphinx-quickstart on Wed Mar 19 11:27:15 2025. You can adapt this file completely to your liking, but it should at least contain the root `toctree` directive. cz-benchmarks Documentation =========================== What is cz-benchmarks? ======================= cz-benchmarks is a package for standardized evaluation and comparison of machine learning models for biological applications (first, in the single-cell transcriptomics domain, with future plans to expand to additional domains). The package provides a toolkit for running containerized models, executing biologically-relevant tasks, and computing performance metrics. We see this tool as a step towards ensuring that large-scale AI models can be harnessed to deliver genuine biological insights -- by building trust, accelerating development, and bridging the gap between ML and biology communities. Why benchmarking? Why now? ========================== Last year, CZI hosted a workshop focused on benchmarking and evaluation of AI models in biology, and the `insights gained `_ have reinforced our commitment to supporting the development of a robust benchmarking infrastructure, which we see as critical to achieving our Virtual Cell vision. 💬 Community Feedback & Contributions ====================================== We're working to get the alpha version of cz-benchmarks stable to build with the community. In the meantime, for issues you may identify, feel free to `open an issue `_ on GitHub or reach out to us at `virtualcellmodels@chanzuckerberg.com `_. You can find **cz-benchmarks** on: - `PyPI `_ – for installation and release information. - `GitHub `_ – for source code, issue tracking, and contributions. **Project Status: UNSTABLE** .. warning:: ** 🚧 Under Development** - This project is under development and not yet stable. It is being actively developed, but not supported and not ready for community contribution. Things may break without notice, and it is not likely the developers will respond to requests for user support. Feedback and contributions are welcome, but user support is limited for now. .. toctree:: :maxdepth: 1 quick_start how_to_guides/index developer_guides/index api_reference assets policy/index roadmap legal changelog_release_notes