Feature Requests & Feedback

I am currently integrating both the friendli and friendli-client packages into my project and have encountered a dependency conflict concerning the httpx library: friendli requires httpx versions >=0.27.0 and <0.28.0. friendli-client requires httpx versions >=0.26.0 and <0.27.0. This conflict prevents the simultaneous installation of both packages. I would appreciate any guidance on resolving this issue or information on upcoming releases that might address this dependency alignment. Thank you for your attention to this matter.

Description: We need an API route that allows uploading text files and returns a corresponding file ID. Currently, processing text files requires a file ID, but there is no available API endpoint for uploading files and retrieving this ID. Request: Provide an API route for file uploads that returns a file ID, enabling seamless processing of text files via the API.

I want to have prepaid credit in order to limit the usage of each of my students.

Friendliai engine natively supports Speculative decoding. There is no instruction about it Friendli container doc. Can you please let me know how to use this feature