1. 07 Mar, 2025 1 commit
  2. 13 Feb, 2025 1 commit
  3. 22 Oct, 2024 1 commit
  4. 09 Sep, 2024 1 commit
  5. 16 Jul, 2024 2 commits
  6. 24 Jun, 2024 1 commit
  7. 29 May, 2024 2 commits
  8. 11 Apr, 2024 1 commit
  9. 18 Sep, 2023 1 commit
  10. 24 Aug, 2023 1 commit
  11. 31 May, 2023 1 commit
    • Sourab Mangrulkar's avatar
      accelerate deepspeed and gradient accumulation integrate (#23236) · a73b1d59
      Sourab Mangrulkar authored
      * mixed precision support via accelerate
      
      * fix issues
      
      * fix for the sharded ddp case
      
      * fix flax and tf failing tests
      
      * `refactor the place to create `Accelerator` object
      
      * move ddp prep to accelerate
      
      * fix 😅
      
      * resolving comments
      
      * move fsdp handling to accelerate
      
      * fixex
      
      * fix saving
      
      * shift torch dynamo handling to accelerate
      
      * shift deepspeed integration and save & load utils to accelerate
      
      * fix accelerate launcher support
      
      * oops
      
      * fix 🐛
      
      * save ckpt fix
      
      * Trigger CI
      
      * nasty 🐛 😅
      
      * as deepspeed needs grad_acc fixes, transfer grad_acc to accelerate
      
      * make tests happy
      
      * quality 
      
      * loss tracked needs to account for grad_acc
      
      * fixing the deepspeed tests
      
      * quality 
      
      * 😅😅😅
      
      * tests 😡
      
      * quality 
      
      
      
      * Trigger CI
      
      * resolve comments and fix the issue with the previous merge from branch
      
      * Trigger CI
      
      * accelerate took over deepspeed integration
      
      ---------
      
      Co-authored-by: default avatarStas Bekman <stas@stason.org>
      a73b1d59
  12. 14 Feb, 2023 1 commit
  13. 13 Feb, 2023 1 commit
  14. 19 Jan, 2023 1 commit
  15. 16 Jan, 2023 1 commit
  16. 04 Jan, 2023 1 commit
  17. 08 Dec, 2022 1 commit
  18. 03 Oct, 2022 1 commit
  19. 29 Jun, 2022 1 commit
  20. 12 May, 2022 1 commit
  21. 18 Apr, 2022 1 commit