backend_demo / main_backend_lighteval.py

Commit History

Added admin exception for counters
98eee75

Shaltiel commited on

Updated backend to use rejected
ffccb41

Shaltiel commited on

Adjusted caps and params
d3573c0

Shaltiel commited on

Added 4bit support
3af3367

Shaltiel commited on

Added t4s back in for small models
59447e3

Shaltiel commited on

Moved back to a10g
17f7b4d

Shaltiel commited on

space change
5c49547

Shaltiel commited on

Updated reqs and allowed larger moels
ca8bbe5

Shaltiel commited on

Updated counters to use use info
15b1ab3

Shaltiel commited on

Added instance size t ocounter key
0270220

Shaltiel commited on

Added failed handling for large models
398ca01

Shaltiel commited on

Updated instance sizes
0e63ee0

Shaltiel commited on

Added caps management
0f5c75a

Shaltiel commited on

Added revision + increased batch size
7135a84

Shaltiel commited on

Adjusted large dtype
3042a5d

Shaltiel commited on

choose better instance size
ee78bc4

Shaltiel commited on

Swapped to p4de
a04d546

Shaltiel commited on

Moved back to T4
e301a6e

Shaltiel commited on

Moved to A100
288c838

Shaltiel commited on

Fixed spelling
ae8f4f4

Shaltiel commited on

Added support for large models
ca54606

Shaltiel commited on

Updated json dump + fix evaluation
eb2a0ba

Shaltiel commited on

Added sentiment, added lots of monkey patching
7798457

Shaltiel commited on

fixed recursion
8ff6e46

Shaltiel commited on

Fixed patch
9ff3dc7

Shaltiel commited on

Try 2 with monkey patch
01b7fc0

Shaltiel commited on

monkey patch func 3
18f5bd1

Shaltiel commited on

Added disable tqdm
ef4c1c3

Shaltiel commited on

Fixed return
5c22430

Shaltiel commited on

Fixed add special tokens
8447248

Shaltiel commited on

Patched tokenization
19caf33

Shaltiel commited on

Patched the task
d243b31

Shaltiel commited on

Redo metric
7e34f5e

Shaltiel commited on

Updated container + instance type
79410f6

Shaltiel commited on

Removed TGI docker update
4debe6f

Shaltiel commited on

Monkeypatched create inference
cc39e19

Shaltiel commited on

Fix patch
fa2a7fa

Shaltiel commited on

Updated config patch
c911bc5

Shaltiel commited on

Added patch for name
3f6926c

Shaltiel commited on

Added monkey patch
4eba5d7

Shaltiel commited on

Prepped for QA test
b686823

Shaltiel commited on

changed default instance to cpu just in case
6902167

Clémentine commited on

added example for parameters
18abd06

Clémentine commited on

updated backend
08ae6c5

Clémentine commited on