Wordvice’s Large-Scale Study of False Positives in AI Detection Accepted to EMNLP 2026 Industry Track
Sep 17, 2026
Analysis of more than 135,000 pairs of original and edited academic manuscripts finds that professional human editing alone can change AI detection results
Seoul, Korea (South), September 17, 2026 -- “AI detector scores alone cannot establish whether AI was used. Manuscript evaluation should consider the quality of the work and how it was written and edited.”
Wordvice, a global provider of proofreading and editing services and AI writing solutions, has announced a study examining the reliability of AI text detectors and their false-positive rates using more than 135,000 pairs of real-world academic manuscripts. The study was accepted to the EMNLP 2026 Industry Track, part of an international conference on natural language processing.
The study, “Style as a Confound: False Positives in AI Detection of Non-Native Academic Writing,” analyzed 135,389 pairs of academic manuscripts, collected between 2018 and 2025, before and after professional editing. By comparing original and edited versions with the same authorship and research content, the researchers examined how changes in grammar, fluency, and academic style affect AI detection results.
The researchers evaluated 13 AI text detectors using various approaches, including methods based on token statistics, zero-shot detection, and classifiers. They found that false-positive rates for the same set of human-written academic manuscripts varied widely across detection methods, ranging from 0% to 100%.
In particular, AI detection results changed significantly after these manuscripts underwent professional human editing. For several major classifier-based detectors, including MAGE and RADAR, professional editing reduced the false-positive rate at which human-written text was classified as AI-generated. However, other detection methods exhibited the opposite pattern. In addition, more extensive editing was associated with greater changes in AI detection scores.
According to the researchers, these findings suggest that AI detectors can be influenced not only by who or what produced a text but also by various characteristics, such as writing style and linguistic quality. Because legitimate language improvements, such as professional English editing routinely used in academic publishing, can change detection results, the findings call for caution in treating AI detector scores as definitive evidence of AI use.
“An AI detector score reflects how a particular detection method evaluates a text. It cannot, on its own, determine how that text was actually written,” a Wordvice spokesperson stated. “Rather than revising their writing to lower AI detector scores, researchers should focus on improving the clarity, accuracy, academic quality, and publication readiness of their manuscripts.”
The study was conducted during Hyeonchu Park’s internship at Wordvice. Park is a researcher at Chung-Ang University’s Graduate School of Artificial Intelligence, supervised by Professor Bugeun Kim. The research provides empirical evidence to inform the interpretation of AI detector results, particularly in academic writing by nonnative English-speaking researchers. Previous studies have compared different groups of writers, whereas this study directly compared the same academic manuscripts.
About Wordvice
Wordvice is a global education technology company built on academic English editing services provided by native English-speaking editors with expertise across numerous research disciplines. In addition to professional editing, the company offers a range of AI writing solutions for researchers, including a grammar checker, translation, paraphrasing, summarization, and AI detection. Drawing on its expertise in professional human editing and AI technology, Wordvice helps researchers improve the quality of their academic writing and more efficiently prepare manuscripts for publication, while also studying the reliability and fairness of AI writing and detection technology.
The preprint is available on arXiv.
Paper title: “Style as a Confound: False Positives in AI Detection of Non-Native Academic Writing”
Accepted to EMNLP 2026 Industry Track
Contact Info:
Name: Gahye Jeong
Email: Send Email
Organization: Wordvice
Website: https://wordvice.ai
Release ID: 89203597
In case of detection of errors, concerns, or irregularities in the content provided in this press release, or if there is a need for a press release takedown, we strongly encourage you to reach out promptly by contacting [email protected] (it is important to note that this email is the authorized channel for such matters, sending multiple emails to multiple addresses does not necessarily help expedite your request). Our efficient team will be at your disposal for immediate assistance within 8 hours – resolving identified issues diligently or guiding you through the removal process. We take great pride in delivering reliable and precise information to our valued readers.
Apple’s new HomePod mini 2 speakers feature Sound Glow and will eventually support Siri AI
It’s been six years since the first HomePod mini, so now we are getting a much-needed update to keep it fresh.
Meta wants to put more AI technology on our faces
At Meta Connect 2026, Meta unveiled its latest AI glasses, shared how they’re bringing the Muse personal AI agent to glasses, and introduced the all-new Meta VR Glasses.
Casetify gives Hello Kitty a very Y2K makeover with its latest collection
Leopard prints, hot pink and sticker-covered cases bring early-2000s visuals to iPhones and other accessories.
Only 17% of Philippine businesses have a roadmap to scale AI
Only 17% of businesses in the Philippines have a roadmap for scaling artificial intelligence (AI), highlighting a gap between growing adoption of the technology and companies’ ability to integrate it more deeply into their operations. The finding comes from Unlocking the Philippines’ AI Potential 2026, a report commissioned by Amazon Web Services (AWS) and conducted
Securing equipment emerges as new variable for Korea's chip expansion plans
Securing equipment for manufacturing advanced memory chips is emerging as a new variable in Korea's plans to expand semiconductor production capacity through large-scale industrial clusters, after ASML, the dominant supplier of advanced chipmaking equipment, warned that its current production plans may not be sufficient to meet demand in 2027 and 2028. During its earnings call Wednesday, ASML CEO Christophe Fouquet said the company's plans to increase its production capacity for advanced chipmaking equipment by 30 percent in 2027 and another 30 percent in 2028 would likely not be enough to meet customer demand. “Last quarter, we talked about 30 percent more capacity next year, and also the aspiration to have another 30 percent increase in 2028,” Fouquet said. “But to be honest, it's becoming very clear that 30 percent in 2027, 30 percent in 2028 will not allow us to meet our customer demand.” According to the company, the planned capacity increases cover both low-numerical-aperture extreme ultraviolet (low-NA EUV) lithography equipment and deep ultraviolet (DUV) immersion system
Musinsa teams up with Japan's ZOZOTOWN for 1st Korean pop-up
Fashion platform Musinsa has teamed up with ZOZOTOWN, one of Japan's leading online fashion retailers, to open a pop-up store in Seongsu-dong, Seoul, a popular destination for young consumers. Musinsa opened the doors to ZOZOTOWN in Musinsa, the Japanese platform’s first official pop-up store in Korea, to the media on Friday. The pop-up will run through Oct. 31, while an accompanying online promotion will continue until Nov. 16. Launched in 2004, ZOZOTOWN features more than 11,000 brands and serving over 13 million customers annually. Fifteen Japanese fashion brands available on the platform, including Snidel and Grancy, are participating in the event. The pop-up’s concept, ZOZO is Coming to Town, draws inspiration from Korean streets. Crosswalks, road markings and oversized three-dimensional typography have been incorporated into the space to create the impression of an intersection where Korean and Japanese fashion meet. The pop-up follows the signing of a memorandum of understanding between the two platforms in December 2024 to establish a strategic partnership. In November last y
China’s proposed AI tech export bans may create short-term costs, long-term gains: analysts
China’s proposed export bans and controls of artificial intelligence technologies aim to tighten Beijing’s grip in the strategically vital sector, casting a cloud over the commercial prospects of domestic model developers in the global AI race, analysts say. The new measures come as concerns mount globally over the risks of advanced AI systems, following a string of recent cyberattacks, while also underscoring AI’s growing national security importance for both Beijing and Washington. Zhang Yi,...
EA producer confirms the return of Wing Commander
MANILA, Philippines – A panel at the Portland Retro Gaming Expo on game preservation revealed that the master tapes containing high quality source video for Wing Commander III were located. The contents of these tapes will now undergo restoration and preparation is at work for a new release of the game, tentatively called Wing Commander
Ride-hailing app taps AI to improve customer, driver experience
MANILA, Philippines – Ride-hailing app, inDrive, wants to use artificial intelligence (AI) to improve mobility in the Philippines while keeping passengers and drivers in control of their choices. The company is exploring how AI can address practical challenges such as traffic, passenger safety and driver earning, in line with its push to make travel decisions
Apple says iPhone Duo demand is “extraordinary” as shipping dates slip to late January 2027
Pre-orders for Apple’s first foldable iPhone have pushed estimated delivery dates into late January 2027, but it’s unclear whether this reflects strong demand or limited launch inventory.
Bipartisan senators ask Pentagon to answer for Ukraine Starlink restrictions
{beacon} Technology Technology The Big Story GOP senators press Pentagon over Starlink restrictions in Ukraine Four Republican senators joined their Democratic colleagues in pressing the Trump administration for information about whether Pentagon officials ordered restrictions on Ukraine’s access to the satellite-based Starshield network. © Tom Brenner, Associated Press Ukraine needs access to fast Starshield data...
Where to preorder the iPhone Duo?
Last night, the Philippines celebrated the launch of the iPhone 18 Pro and Pro Max. The elephant in the room however was information on the availability of the upcoming iPhone Duo. Industry insiders say that Apple’s first foldable will come in very limited stocks. But that doesn’t mean that consumers won’t get the chance to
YOUR NEWS, OUR NETWORK.
Do you have Great News you want to tell the world?
Be it updates about your business or your community, you can make sure that it’s heard by submitting your story to our network reaching hundreds of news sites across 6 verticals.