Skip to content

Add rezero option; register ops for APEX AMP training#192

Open
taoleicn wants to merge 5 commits into
3.0.0-devfrom
3.0.0-dev-apex
Open

Add rezero option; register ops for APEX AMP training#192
taoleicn wants to merge 5 commits into
3.0.0-devfrom
3.0.0-dev-apex

Conversation

@taoleicn

@taoleicn taoleicn commented Jun 25, 2021

Copy link
Copy Markdown
Contributor
  • add rezero option
  • register ops for APEX AMP training

@taoleicn taoleicn requested review from hpasapp and jinpoon June 25, 2021 19:16
@taoleicn

Copy link
Copy Markdown
Contributor Author

Make sure the 3.0.0 (dev) branch has all the changes needed for our model training.
I'll test if this branch & version works for ESPNET ASR training.

@taoleicn taoleicn self-assigned this Jun 25, 2021
@hpasapp

hpasapp commented Jun 25, 2021

Copy link
Copy Markdown
Contributor

I wonder if we need tests for apex? Otherwise it will break from time to time, and we wont know about it, until someone complains.

@taoleicn

Copy link
Copy Markdown
Contributor Author

@hpasapp great point. I'll try adding some tests before next Friday.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants