Skip to content

Migrate/enhance quantization jupyter notebooks #111

@chichun-charlie-liu

Description

@chichun-charlie-liu

Is your feature request related to a problem? Please describe.

There were 5 quantization-related Jupyter Notebooks in the old sq1e repo which are also served on IBM Research JupyterLab. Only one of them have been migrated to the fms-mo so far. Since these notebooks will be quite helpful for new users. we should refresh and incorporate the notebooks into fms-mo.

Describe the solution you'd like

  • we will enable notebooks 01 (intro), 02 (EDSR), 03 (QAT), 06 (HAP). (01 is done, re-use fms-mo/tutorial version)

Yogesh(Yogesh.Jadhav1@ibm.com) will:

  • upgrade the use of sq1e to fms-mo in these notebooks.
  • simplify the CLI-style "args" to "json" style.
  • commit newly revised notebooks back to fms-mo tutorial folder, so we only need to maintain one set of notebooks.

@kcirred @chichun-charlie-liu will:

  • review EDSR notebook and debug for incorrect accuracy numbers
  • try to reduce runtime of QAT notebook with more CPU-friendly settings.

Describe alternatives you've considered

Since fms-mo is almost a drop-in replacement for old sq1e repo, migration the notebooks would simply mean changing the imports. However, there are also some syntax simplifications/changes in fms-mo compared to sq1e, a careful review and test of the notebooks will be needed.

Additional context

These notebooks are assuming "CPU-only" environment. QAT notebook will need to be further adjusted

Metadata

Metadata

Labels

documentationImprovements or additions to documentation

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions