.. Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at .. http://www.apache.org/licenses/LICENSE-2.0 .. Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. .. _release_process: Release Process =============== .. contents:: :depth: 2 :local: The release manager role in TVM means you are responsible for a few different things: - Preparing release notes - Preparing your setup - Preparing for release candidates - Cutting a release branch - Informing the community of timing - Making any necessary code changes in that branch (versions are derived from Git tags, so there are no manual version-number edits) - Running the voting process for a release - Creating release candidates - Calling votes and triaging issues - Finalizing and posting a release: - Updating the TVM website - Finalizing release notes - Announcing the release Versioning ---------- TVM's version is derived automatically from the most recent Git tag by `setuptools_scm `_ at build time (configured under ``[tool.setuptools_scm]`` in ``pyproject.toml``). There are **no version numbers to edit by hand** in ``pyproject.toml``, ``python/tvm/libinfo.py`` or ``include/tvm/runtime/base.h``; releasing is driven entirely by pushing Git tags: - ``main`` carries a ``vMAJOR.MINOR.devN`` tag (e.g. ``v0.7.dev0``). Commits after it are versioned ``0.7.devN`` where ``N`` is the number of commits since the tag. This is why the next dev tag must be pushed on ``main`` when a release branch is cut: without it, follow-up commits would keep deriving their version from the previous cycle's tag. - A release branch (e.g. ``v0.6``) is tagged ``v0.6.0.rc0`` for a candidate (wheel version ``0.6.0rc0``) and ``v0.6.0`` for the formal release (wheel version ``0.6.0``). Release wheels are built on the exact tag, so the version is the tag itself. The legacy ``version.py`` stamping script has been removed. ``web/package.json`` (npm, a separate ecosystem) is no longer auto-stamped; bump it by hand when starting a new dev cycle or cutting a release. ``docs/conf.py`` reads ``tvm.__version__`` directly. Prepare the Release Notes ------------------------- Release note contains new features, improvement, bug fixes, known issues and deprecation, etc. TVM provides `monthly dev report `_ collects developing progress each month. It could be helpful to who writes the release notes. It is recommended to open a GitHub issue to collect feedbacks for the release note draft before cutting the release branch. See the scripts in ``tests/scripts/release`` for some starting points. Prepare the Release Candidate ----------------------------- There may be some code changes necessary on the release branch before the release (for example cherry-picked fixes). Version numbers are derived from the release tags (see `Versioning`_), so there are no version numbers to update by hand. Prepare the GPG Key ------------------- You can skip this section if you have already uploaded your key. After generating the gpg key, you need to upload your key to a public key server. Please refer to https://www.apache.org/dev/openpgp.html#generate-key for details. If you want to do the release on another machine, you can transfer your gpg key to that machine via the ``gpg --export`` and ``gpg --import`` commands. The last step is to update the KEYS file with your code signing key https://www.apache.org/dev/openpgp.html#export-public-key. Check in the changes to the TVM main branch, as well as ASF SVN, .. code-block:: bash # the --depth=files will avoid checkout existing folders svn co --depth=files "https://dist.apache.org/repos/dist/dev/tvm" svn-tvm cd svn-tvm # edit KEYS file svn ci --username $ASF_USERNAME --password "$ASF_PASSWORD" -m "Update KEYS" # update downloads.apache.org (note that only PMC members can update the dist/release directory) svn rm --username $ASF_USERNAME --password "$ASF_PASSWORD" https://dist.apache.org/repos/dist/release/tvm/KEYS -m "Update KEYS" svn cp --username $ASF_USERNAME --password "$ASF_PASSWORD" https://dist.apache.org/repos/dist/dev/tvm/KEYS https://dist.apache.org/repos/dist/release/tvm/ -m "Update KEYS" Cut a Release Candidate ----------------------- To cut a release candidate for the ``v0.6`` release: #. On the ``main`` commit that should be the last one included in the release, push the **next** dev-cycle tag ``v0.7.dev0``. This tag is what makes subsequent ``main`` commits versioned ``0.7.devN`` (see `Versioning`_), so it must be pushed *before* branching. #. Cut the release branch off that same commit. Branches are named with the base release version without the patch, e.g. ``v0.6`` for the ``v0.6.0`` release. #. Push the first release-candidate tag ``v0.6.0.rc0`` on the release branch. CI then builds the candidate wheel (version ``0.6.0rc0``) for PyPI/TestPyPI testing. Keep this tag on a ``v0.6`` branch commit that is **not** also the ``v0.7.dev0``-tagged branch point: when two tags share one commit, which one ``setuptools_scm`` picks is fragile, so put the candidate tag on a release-prep commit on the branch. .. code-block:: bash git clone https://github.com/apache/tvm.git cd tvm/ # 1. Tag the next dev cycle on main (drives main's 0.7.devN version), # on the last commit to be included in the release. git checkout git tag v0.7.dev0 git push origin refs/tags/v0.7.dev0 # 2. Cut the release branch off that same commit. git branch v0.6 git push --set-upstream origin v0.6 # 3. Tag the first release candidate on the release branch. Keep this tag on a # release-prep commit, NOT the v0.7.dev0-tagged branch point, so the two tags # never share a commit. git checkout v0.6 # ... make any release-prep commits (release notes, etc.) here ... git tag v0.6.0.rc0 git push origin refs/tags/v0.6.0.rc0 The wheel/distribution version is derived from these tags by ``setuptools_scm`` at build time, so no source files need editing and you no longer run ``version.py`` to stamp the version (see `Versioning`_). Go to the GitHub repositories "releases" tab and click "Draft a new release", - Verify the release by checking the version numbers and ensuring that TVM can build and run the unit tests. - Provide the release tag in the form of ``v1.0.0.rc0`` where 0 means it's the first release candidate. The tag must match this pattern ``v[0-9]+\.[0-9]+\.[0-9]+\.rc[0-9]`` exactly! - Select the commit by clicking Target: branch > Recent commits > $commit_hash - Copy and paste release note draft into the description box - Select "This is a pre-release" - Click "Publish release" Notice that one can still apply changes to the branch after the cut, while the tag is fixed. If any change is required for this release, a new tag has to be created. Remove previous release candidate (if applied), .. code-block:: bash git push --delete origin v0.6.0.rc1 Create source code artifacts, .. code-block:: bash # Replace v0.6.0 with the relevant version git clone git@github.com:apache/tvm.git apache-tvm-src-v0.6.0 cd apache-tvm-src-v0.6.0 git checkout v0.6 git submodule update --init --recursive git checkout v0.6.0.rc0 rm -rf .DS_Store find . -name ".git*" -print0 | xargs -0 rm -rf cd .. brew install gnu-tar gtar -czvf apache-tvm-src-v0.6.0.rc0.tar.gz apache-tvm-src-v0.6.0 Use your GPG key to sign the created artifact. First make sure your GPG is set to use the correct private key, .. code-block:: bash $ cat ~/.gnupg/gpg.conf default-key F42xxxxxxxxxxxxxxx Create GPG signature as well as the hash of the file, .. code-block:: bash gpg --armor --output apache-tvm-src-v0.6.0.rc0.tar.gz.asc --detach-sig apache-tvm-src-v0.6.0.rc0.tar.gz shasum -a 512 apache-tvm-src-v0.6.0.rc0.tar.gz > apache-tvm-src-v0.6.0.rc0.tar.gz.sha512 Update TVM Version on ``main`` ------------------------------ The next dev-cycle tag pushed on ``main`` during the cut (step 1 above, e.g. ``v0.7.dev0``) is what gives ``main`` its ``0.7.devN`` version — ``setuptools_scm`` derives it from that tag, so there are **no source version numbers to bump** (the old two-commit ``[Dont Squash]`` bump and the ``python version.py`` stamping step are no longer needed). Make sure that tag sits on the ``main`` commit immediately after the last one included in the release branch; it is required so that nightly/dev packages built from ``main`` carry the correct ``0.7.devN`` version. Upload the Release Candidate ---------------------------- Edit the release page on GitHub and upload the artifacts created by the previous steps. The release manager also needs to upload the artifacts to ASF SVN, .. code-block:: bash # the --depth=files will avoid checkout existing folders svn co --depth=files "https://dist.apache.org/repos/dist/dev/tvm" svn-tvm cd svn-tvm mkdir tvm-v0.6.0-rc0 # copy files into it svn add tvm-0.6.0-rc0 svn ci --username $ASF_USERNAME --password "$ASF_PASSWORD" -m "Add RC" Cherry-Picking -------------- After a release branch has been cut but before the release has been voted on, the release manager may cherry-pick commits from ``main``. Since release branches are protected on GitHub, to merge this fixes into the release branch (e.g. ``v0.11``), the release manager must file a PR with the cherry-picked changes against the release branch. The PR should roughly match the original one from ``main`` with extra details on why the commit is being cherry-picked. The community then goes through a normal review and merge process for these PRs. Note that these PRs against the release branches must be `signed `_. Call a Vote on the Release Candidate ------------------------------------ The first voting takes place on the Apache TVM developers list (dev@tvm.apache.org). To get more attention, one can create a GitHub issue start with "[VOTE]" instead, it will be mirrored to dev@ automatically. Look at past voting threads to see how this proceeds. The email should follow this format. - Provide the link to the draft of the release notes in the email - Provide the link to the release candidate artifacts - Make sure the email is in text format and the links are correct For the dev@ vote, there must be at least 3 binding +1 votes and more +1 votes than -1 votes. Once the vote is done, you should also send out a summary email with the totals, with a subject that looks something like [VOTE][RESULT] .... In ASF, votes are open at least 72 hours (3 days). If you don't get enough number of binding votes within that time, you cannot close the voting deadline. You need to extend it. If the vote fails, the community needs to modify the release accordingly: create a new release candidate and re-run the voting process. Post the Release ---------------- After the vote passes, to upload the binaries to Apache mirrors, you move the binaries from dev directory (this should be where they are voted) to release directory. This "moving" is the only way you can add stuff to the actual release directory. (Note: only PMC can move to release directory) .. code-block:: bash export SVN_EDITOR=vim svn mkdir https://dist.apache.org/repos/dist/release/tvm svn mv https://dist.apache.org/repos/dist/dev/tvm/tvm-v0.6.0-rc2 https://dist.apache.org/repos/dist/release/tvm/tvm-v0.6.0 # If you've added your signing key to the KEYS file, also update the release copy. svn co --depth=files "https://dist.apache.org/repos/dist/release/tvm" svn-tvm curl "https://dist.apache.org/repos/dist/dev/tvm/KEYS" > svn-tvm/KEYS (cd svn-tvm && svn ci --username $ASF_USERNAME --password "$ASF_PASSWORD" -m"Update KEYS") Remember to create a new release TAG (v0.6.0 in this case) on GitHub and remove the pre-release candidate TAG. .. code-block:: bash git push --delete origin v0.6.0.rc2 Update the TVM Website ---------------------- The website repository is located at `https://github.com/apache/tvm-site `_. Modify the download page to include the release artifacts as well as the GPG signature and SHA hash. Since TVM's docs are continually updated, upload a fixed version of the release docs. If CI has deleted the docs from the release by the time you go to update the website, you can restart the CI build for the release branch on Jenkins. See the example code below for a starting point. .. code-block:: bash git clone https://github.com/apache/tvm-site.git pushd tvm-site git checkout asf-site pushd docs # make release docs directory mkdir v0.9.0 pushd v0.9.0 # download the release docs from CI # find this URL by inspecting the CI logs for the most recent build of the release branch curl -LO https://tvm-jenkins-artifacts-prod.s3.us-west-2.amazonaws.com/tvm/v0.9.0/1/docs/docs.tgz tar xf docs.tgz rm docs.tgz # add the docs and push git add . git commit -m "Add v0.9.0 docs" git push Afterwards, modify the `downloads page `_ to support the latest release. An example of how to do this is `here `_. Post the Announcement --------------------- Send out an announcement email to announce@apache.org, and dev@tvm.apache.org. The announcement should include the link to release note and download page. Patch Releases -------------- Patch releases should be reserved for critical bug fixes. Patch releases must go through the same process as normal releases, with the option at the release manager's discretion of a shortened release candidate voting window of 24 hours to ensure that fixes are delivered quickly. A patch release is cut purely by tagging the release base branch (e.g. ``v0.11``): push ``v0.11.1.rc0`` for the candidate and ``v0.11.1`` for the formal patch release; no source version numbers need bumping.