Search
Search titles only
By:
Search titles only
By:
Forums
New posts
Search forums
What's new
New posts
Latest activity
Feedback
View Statistics
Members
Current visitors
Buy Sell Trade
WTB
Log in
Register
Search
Search titles only
By:
Search titles only
By:
New posts
Search forums
Menu
Install the app
Install
Reply to thread
Forums
Technology
Programming
Need help with pytorch....cannot resume training
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Message
<blockquote data-quote="vishalrao" data-source="post: 2464325" data-attributes="member: 15724"><p>Update: The 30% improvement was with the shakespear-char (tiny) dataset but I see a <strong>massive 6X (600% or is it 500%) improvement</strong> with the mini GPT2 dataset when changing the dtype from bfloat16 to float32 running on my RX580 lol.</p></blockquote><p></p>
[QUOTE="vishalrao, post: 2464325, member: 15724"] Update: The 30% improvement was with the shakespear-char (tiny) dataset but I see a [B]massive 6X (600% or is it 500%) improvement[/B] with the mini GPT2 dataset when changing the dtype from bfloat16 to float32 running on my RX580 lol. [/QUOTE]
Insert quotes…
Verification
Post reply
Forums
Technology
Programming
Need help with pytorch....cannot resume training
Top
Bottom