• Susnato Dhar's avatar
    Add CLVP (#24745) · 7e9f10ac
    Susnato Dhar authored
    * init commit
    
    * attention arch done except rotary emb
    
    * rotary emb done
    
    * text encoder working
    
    * outputs matching
    
    * arch first pass done
    
    * make commands done, tests and docs remaining
    
    * all tests passed, only docs remaining
    
    * docs done
    
    * doc-builder fix
    
    * convert script removed(not relevant)
    
    * minor comments done
    
    * added ckpt conversion script
    
    * tokenizer done
    
    * very minor fix of index.md 2
    
    * mostly make fixup related
    
    * all done except fe and rotary emb
    
    * very small change
    
    * removed unidecode dependency
    
    * style changes
    
    * tokenizer removed require_backends
    
    * added require_inflect to tokenizer tests
    
    * removed VOCAB_FILES in tokenizer test
    
    * inflect dependency removed
    
    * added rotary pos emb cache and simplified the apply method
    
    * style
    
    * little doc change
    
    * more comments
    
    * feature extractor added
    
    * added processor
    
    * auto-regressive config added
    
    * added CLVPConditioningEncoder
    
    * comments done except the test one
    
    * weights added successfull(NOT tested)
    
    * tokenizer fix with numbers
    
    * generate outputs matching
    
    * almost tests passing Integ tests not written
    
    * Integ tests added
    
    * major CUDA error fixed
    
    * docs done
    
    * rebase and multiple fixes
    
    * fixed rebase overwrites
    
    * generate code simplified and tests for AutoRegressive model added
    
    * minor changes
    
    * refectored gpt2 code in clvp file
    
    * weights done and all code refactored
    
    * mostly done except the fast_tokenizer
    
    * doc test fix
    
    * config file's doc fixes
    
    * more config fix
    
    * more comments
    
    * tokenizer comments mostly done
    
    * modeling file mostly refactored and can load modules
    
    * ClvpEncoder tested
    
    * ClvpDecoder, ClvpModel and ClvpForCausalLM tested
    
    * integration and all tests passed
    
    * more fixes
    
    * docs almost done
    
    * ckpt conversion refectored
    
    * style and some failing tests fix
    
    * comments
    
    * temporary output fix but test_assisted_decoding_matches_greedy_search test fails
    
    * majority changes done
    
    * use_cache outputs same now! Along with the asisted_greedy_decoding test fix
    
    * more comments
    
    * more comments
    
    * prepare_inputs_for_generation fixed and _prepare_model_inputs added
    
    * style fix
    
    * clvp.md change
    
    * moved clvpconditionalencoder norms
    
    * add model to new index
    
    * added tokenizer input_ids_with_special_tokens
    
    * small fix
    
    * config mostly done
    
    * added config-tester and changed conversion script
    
    * more comments
    
    * comments
    
    * style fix
    
    * some comments
    
    * tokenizer changed back to prev state
    
    * small commnets
    
    * added output hidden states for the main model
    
    * style fix
    
    * comments
    
    * small change
    
    * revert small change
    
    * .
    
    * Update clvp.md
    
    * Update test_modeling_clvp.py
    
    * :)
    
    * some minor change
    
    * new fixes
    
    * remove to_dict from FE
    7e9f10ac