• Yoach Lacombe's avatar
    Add SeamlessM4T v2 (#27779) · 29f1aee3
    Yoach Lacombe authored
    
    
    * add working convertion script
    
    * first non-working version of modeling code
    
    * update modeling code (working)
    
    * make style
    
    * make fix-copies
    
    * add config docstrings
    
    * add config to ignore docstrings formatage due to unconventional markdown
    
    * fix copies
    
    * fix generation num_return_sequences
    
    * enrich docs
    
    * add and fix tests beside integration tests
    
    * update integration tests
    
    * update repo id
    
    * add tie weights and make style
    
    * correct naming in .md
    
    * fix imports and so on
    
    * correct docstrings
    
    * fix fp16 speech forward
    
    * fix speechencoder attention
    
    * make style
    
    * fix copied from
    
    * rename SeamlessM4Tv2-v2 to SeamlessM4Tv2
    
    * Apply suggestions on configuration
    
    Co-authored-by: default avatarArthur <48595927+ArthurZucker@users.noreply.github.com>
    
    * remove useless public models
    
    * fix private models + better naming for T2U models
    
    * clean speech encoder relative position embeddings
    
    * refactor chunk attention
    
    * add docstrings to chunk attention method
    
    * improve naming and docstrings
    
    * rename some attention variables + add temperature sampling in T2U model
    
    * rename DOCSTRINGS variable names
    
    * make style + remove 2 useless config parameters
    
    * enrich model card
    
    * remove any attention_head reference + fix temperature in T2U
    
    * new fmt and make style
    
    * Apply suggestions from code review
    
    Co-authored-by: default avatarArthur <48595927+ArthurZucker@users.noreply.github.com>
    
    * rename spkr_id->speaker_id and change docstrings of get_char_input_ids
    
    * simplify v2attention
    
    * make style
    
    * Update seamless_m4t_v2.md
    
    * update code and tests with last update
    
    * update repo ids
    
    * fill article name, abstract andauthors
    
    * update not_doctested and slow_doc tests
    
    ---------
    
    Co-authored-by: default avatarArthur <48595927+ArthurZucker@users.noreply.github.com>
    29f1aee3