Client:
Multinational Software Products and Services Company
Optimizing Machine Learning Models Through Data Labeling for a B2B Software Company
A leading B2B software company urgently needed to combat phishing and other scams that were targeting its CRM platform. By implementing a streamlined review process, Vaco successfully labeled policy violations in 13+ languages, achieving a 98% confidence level with minimal false positives.
Services:
Area of Expertise:
Industry:
Software Products and Services
The Problem
Facing a surge in phishing and other scams targeting its CRM platform, a multinational software company urgently needed to address its backlog of policy violations. Vaco and three other firms engaged in a competitive data “bake-off” to showcase their expertise in data labeling, vying for the chance to become the company’s outsourced business partner. Vaco prevailed and was selected as the partner to deliver high-quality data labeling results while minimizing the onboarding of resources and upfront time investment.
The Solution
Vaco quickly engaged a dedicated team, including quality assurance specialists to establish quality calibration layers. Initial training sessions and ongoing syncs were led by Vaco to ensure alignment on policy guidelines, documentation requirements and quality expectations. The team dedicated 55 hours to the review process and 12 hours to quality assurance efforts. Equipped with proficiency in five languages, the review team handled nearly all reviews. For unsupported languages, Google Translate was leveraged.
Our Impact
Within four days, the team successfully labeled 2,000 items in 13 native languages and various formats. Vaco delivered all reviewed items in a ZIP file as images and developed a new review process and interface. Furthermore, 432 items underwent rigorous quality assurance testing, achieving a 98% confidence level with a margin of error of 5%. Less than nine false positives were identified. This success enabled the review team to align their training with active reviews. Vaco provided the organization with a comprehensive recap, including relevant metrics, actionable insights and suggested policy clarifications, enabling the enhancement of machine learning modeling for the organization.
0
0
0
With you all the way
If you are looking for business solutions please complete the form below to be contacted by one of our team members.
If you are a job seeker and would like to submit your resume please fill out a form on our Job Seeker page.
©2024 Vaco | All Rights Reserved | Vaco Global Headquarters: 5501 Virginia Way #120, Brentwood, TN 37027