text
Hello Community,
Hello Community,
new_line
new_line
text
I am seeking guidance on solving a complex problem related to tender categorization. Here's a detailed overview of my requirements and challenges:
I am seeking guidance on solving a complex problem related to tender categorization. Here's a detailed overview of my requirements and challenges:
new_line
new_line
text
Problem Statement:
Problem Statement:
new_line
new_line
text
I need to categorize tenders based on their descriptions on a daily basis.
I need to categorize tenders based on their descriptions on a daily basis.
new_line
text
I process over 35,000 tenders daily, each potentially belonging to a vast range of categories. Predicting the exact category for each tender is challenging due to the diversity and complexity of categories.
I process over 35,000 tenders daily, each potentially belonging to a vast range of categories. Predicting the exact category for each tender is challenging due to the diversity and complexity of categories.
new_line
text
Requirements:
Requirements:
new_line
new_line
text
Model Selection: I require a model that can accurately predict the category of each tender based on its description. I plan to create a dataset from 1 million records in the required format to train the model. Post-training, I also need to optimize the model for performance.
Model Selection: I require a model that can accurately predict the category of each tender based on its description. I plan to create a dataset from 1 million records in the required format to train the model. Post-training, I also need to optimize the model for performance.
new_line
text
Training and Optimization: Guidance on the best practices for training and optimizing the model is essential. I am considering Hugging Face’s tools but am unsure about how to effectively use them or any alternatives.
Training and Optimization: Guidance on the best practices for training and optimizing the model is essential. I am considering Hugging Face’s tools but am unsure about how to effectively use them or any alternatives.
new_line
text
Local Deployment: If I opt for a local deployment, I need to know what kind of infrastructure or applications are required to run the model on my own servers efficiently.
Local Deployment: If I opt for a local deployment, I need to know what kind of infrastructure or applications are required to run the model on my own servers efficiently.
new_line
text
Performance: The model must provide responses quickly, given the high volume of tenders.
Performance: The model must provide responses quickly, given the high volume of tenders.
new_line
text
Questions for the Community:
Questions for the Community:
new_line
new_line
text
Model Recommendations:
Model Recommendations:
new_line
new_line
text
Which model or method would be most suitable for categorizing tenders with diverse categories?
Which model or method would be most suitable for categorizing tenders with diverse categories?
new_line
text
What are the best practices for training and optimizing such a model?
What are the best practices for training and optimizing such a model?
new_line
text
Infrastructure and Deployment:
Infrastructure and Deployment:
new_line
new_line
text
What infrastructure or software is needed to deploy a model locally for this purpose?
What infrastructure or software is needed to deploy a model locally for this purpose?
new_line
text
How can I ensure the model performs efficiently on my server?
How can I ensure the model performs efficiently on my server?
new_line
text
Performance Optimization:
Performance Optimization:
new_line
new_line
text
What strategies or techniques can I use to achieve quick response times from the model?
What strategies or techniques can I use to achieve quick response times from the model?
new_line
text
I appreciate any advice, suggestions, or resources you can provide to help address these challenges.
I appreciate any advice, suggestions, or resources you can provide to help address these challenges.
new_line
new_line
text
Thank you!
Thank you!
new_line
new_line
text
Best regards,
Best regards,
new_line
text
Sachin Vaishnav
Sachin Vaishnav
Hello Community,

I am seeking guidance on solving a complex problem related to tender categorization. Here's a detailed overview of my requirements and challenges:

Problem Statement:

I need to categorize tenders based on their descriptions on a daily basis.
I process over 35,000 tenders daily, each potentially belonging to a vast range of categories. Predicting the exact category for each tender is challenging due to the diversity and complexity of categories.
Requirements:

Model Selection: I require a model that can accurately predict the category of each tender based on its description. I plan to create a dataset from 1 million records in the required format to train the model. Post-training, I also need to optimize the model for performance.
Training and Optimization: Guidance on the best practices for training and optimizing the model is essential. I am considering Hugging Face’s tools but am unsure about how to effectively use them or any alternatives.
Local Deployment: If I opt for a local deployment, I need to know what kind of infrastructure or applications are required to run the model on my own servers efficiently.
Performance: The model must provide responses quickly, given the high volume of tenders.
Questions for the Community:

Model Recommendations:

Which model or method would be most suitable for categorizing tenders with diverse categories?
What are the best practices for training and optimizing such a model?
Infrastructure and Deployment:

What infrastructure or software is needed to deploy a model locally for this purpose?
How can I ensure the model performs efficiently on my server?
Performance Optimization:

What strategies or techniques can I use to achieve quick response times from the model?
I appreciate any advice, suggestions, or resources you can provide to help address these challenges.

Thank you!

Best regards,
Sachin Vaishnav
👍
abonilla92 combatsolutions Tanvir1337 ALYTV Ramikan-BR Amritbro Balasubramaniam