벤치마크

모든 승리 예측 모델이 스스로 밝힌 성적

자기 리그 오브 레전드(또는 다른 MOBA) 승리 예측 모델의 수치를 공개한 논문과 웹사이트를 저희가 아는 한 모두 모았습니다. 숫자는 모두 출처의 것이며 한 가지 척도로 적었습니다. 대시(—)는 출처가 그 지표를 밝히지 않았다는 뜻이고, 저희가 대신 계산해 넣지는 않습니다. 각 결과마다 언제 예측하는지, 테스트 경기를 학습과 어떻게 분리했는지, 무엇으로 검증했는지, 그리고 저희가 얼마나 믿는지를 적었습니다.

모든 출처는 2026년 9월 22일에 확인했습니다. 저희 자신의 수치와 그 뒤의 모든 곡선은 정확도 페이지에 있습니다.

0— 공개된 보고 57개 중 자기 모델의 다섯 지표를 모두 밝힌 수 (저희 것은 제외).

한 모델에 대해 각 보고가 밝힌 최대 지표 수: 다섯 중 4개: 4 · 다섯 중 3개: 1 · 다섯 중 2개: 10 · 다섯 중 1개: 36 · 다섯 중 하나도 없이 다른 지표만: 6.

AUC57개 중 8개
로그 손실57개 중 7개
브라이어57개 중 9개
정확도57개 중 47개
ECE57개 중 5개

숫자

다섯 지표 모두 소수로 적습니다. AUC와 정확도는 동전 던지기인 0.5부터 1까지이고, 로그 손실·브라이어·ECE는 오차라서 낮을수록 좋습니다. 점선 밑줄은 출처가 적은 형식을 저희가 바꿔 적었다는 뜻입니다(예: 92.2%를 0.922로). 마우스를 올리면 원래 표기가 보입니다. 숫자 자체는 절대 바꾸지 않습니다.

예측 시점

언제 예측하는지: 밴픽 전, 밴픽 중, 마지막 픽 후 게임 시작 전, 또는 게임 중. 그 아래에는 한 게임(세트) 예측인지 시리즈 전체 예측인지를 적었습니다. 솔로 랭크와 프로 모두 이 기준으로 묶어 비슷한 것끼리 나란히 둡니다.

신뢰도

  • 높음: 학습한 경기보다 나중에 치러진 경기로 검증, 테스트 경기 1,000개 이상, 알려진 문제 없음.
  • 보통: 나중 경기로 검증했지만 경기 수가 적거나 밝히지 않음.
  • 알 수 없음: 출처가 검증 방법을 밝히지 않음.
  • 낮음: 무작위 분할, 아주 작은 테스트, 또는 알려진 문제.

경고

  • 빨강 데이터 누수(출처가 인정했거나 저희가 코드에서 찾아낸 것), 실제 경기 결과로 채점하지 않은 점수, 또는 게임 중 데이터.
  • 주황 무작위 분할, 분할 방법 미기재, 작은 테스트, 또는 나중 경기로 검증한 어떤 결과보다도 훨씬 높은 결과. 경고에 마우스를 올리면 이유가 보입니다.

밴픽 후 15

열 챔피언이 모두 정해졌고 게임은 아직 시작 전. 저희의 두 전체 밴픽 모델과 비교할 수 있는 묶음입니다.

기본 순서: 저희 행, 그다음 가장 잘 검증된 순서. 제목을 누르면 정렬됩니다.
모델 또는 설정검증 데이터
KayLoL웹사이트KayLoL /metrics, layer 1: the held-out patchKayLoL · kaylol.gg · 2026-09-09 build (live payload generated 2026-09-23T01:22:01Z) · 2026년 9월 23일 확인
메모

A second layer on the same page scores every day's games with a model frozen before that day (1.9M predictions per mode, na1, 2026-08-27 onward) and agrees with these within 0.004 on every metric.

all_info_puuid — full draft, all ten players identified밴픽 후한 게임0.65540.65390.23120.61050.0036높음나중 경기로 검증 · 테스트 1,164,446경기시간순whole-patch holdout: trained on patches 16.13-16.16, tested on 16.17, which the model never sawNA ranked solo queue (na1), all tiers; patch 16.17, 2026-08-26 to 09-09; 1,164,446 held-out games, scored on the validation half
KayLoL /metrics, layer 1: the held-out patchall_info_anonymous — full draft, no player identities (champions only)밴픽 후한 게임0.58520.68130.24420.55990.0032높음나중 경기로 검증 · 테스트 1,164,446경기시간순whole-patch holdout: trained on patches 16.13-16.16, tested on 16.17, which the model never sawNA ranked solo queue (na1), all tiers; patch 16.17, 2026-08-26 to 09-09; 1,164,446 held-out games, scored on the validation half
웹사이트DraftGap vs LoLDraftAI: A Detailed ComparisonLoLDraftAI (no visible byline; site-wide HTML meta author 'looyyd') · loldraftai.com · 2026-04-19 ('April 19, 2026') · 2026년 9월 22일 확인
메모

Files published beside the post (exist; not downloaded): https://media.loldraftai.com/blog/draftgap-vs-loldraftai-comparison/predictions.csv.../draftgap-current-patch.json.../draftgap-30-days.json. ECE is described as the 'average gap between stated probability and observed frequency' (bins not stated); no AUC. The post adds: 'The shipped LoLDraftAI product additionally uses side information and fine-grained elo (features DraftGap doesn't have), but they weren't needed to produce this result.' A vendor's comparison against a rival.

+6개 더 (세부 결과 모두 보기)
LoLDraftAI (side-agnostic: 'Side-agnostic prediction (no blue/red knowledge), matching DraftGap's side-blind nature')그 밖의 지표: 95% bootstrap CIs: log loss (0.6811–0.6846), accuracy (55.34–56.42), Brier (0.2441–0.2458)밴픽 후한 게임0.68290.24490.55880.0088높음나중 경기로 검증 · 데이터 전체 32,750경기, 테스트 비중 미기재시간순'LoLDraftAI training cutoff at 2026-04-17, 23:25 UTC'32,750 matches: ranked solo/duo, Emerald+ ('DraftGap pulls its data from Lolalytics at tier=emerald_plus'), EUW1 and KR; 'Matches where any (champion, role) cell has fewer than 50 games in DraftGap's current-patch dataset are excluded'; exact dates and patches not stated
논문DraftRec: Personalized Draft Recommendation for Winning in Multi-Player Online Battle Arena GamesHojoon Lee, Dongyoon Hwang, Hyunseung Kim, Byungkun Lee, Jaegul Choo · WWW 2022 (The ACM Web Conference); arXiv:2204.12750 · 2022-04-27 (arXiv v1, 'Accepted to WWW 2022') · 2026년 9월 22일 확인
메모

The Dota 2 rows are the same paper's second dataset (Dota 2 is not this file's game). Generic baselines in the same tables, not listed above: MC (majority class, 'Blue for LOL and Radiant for Dota2') 0.5040 LoL and 0.5180 Dota 2; LR 0.5255 during and 0.5323 after the draft (LoL), 0.5750 and 0.6126 (Dota 2); NN 0.5263 and 0.5335 (LoL), 0.5748 and 0.6108 (Dota 2). After the Dota 2 draft, LR (0.6126) prints above DraftRec (0.6110). Outcome prediction is the paper's secondary task; its main task is champion recommendation. Code and data: github.com/dojeon-ai/DraftRec.

DraftRec — LoL, after the draft (all ten champions selected)그 밖의 지표: MAE 0.4826 (accuracy and MAE both starred: p<0.01)밴픽 후한 게임0.5618높음나중 경기로 검증 · 테스트 약 27,989경기시간순Last 10% by time of 279,893 LoL matches collected through the Riot Games API: (62,466 players); region and queue not stated; test-set size not stated
DraftRec: Personalized Draft Recommendation for Winning in Multi-Player Online Battle Arena GamesDraftRec-no-history — LoL, after the draft (all ten champions selected)그 밖의 지표: MAE 0.4893밴픽 후한 게임0.5432높음나중 경기로 검증 · 테스트 약 27,989경기시간순Last 10% by time of 279,893 LoL matches collected through the Riot Games API: (62,466 players); region and queue not stated; test-set size not stated
웹사이트LoLTheory vs LoLDraftAI: A Detailed ComparisonLoLDraftAI (no visible byline; site-wide HTML meta author 'looyyd') · loldraftai.com · 2026-04-19 ('April 19, 2026') · 2026년 9월 22일 확인
메모

Per-match predictions published: https://media.loldraftai.com/blog/loltheory-vs-loldraftai-comparison/predictions.csv (exists; not downloaded). 'Parenthetical ranges are 95% bootstrap confidence intervals'. The ECE bin count is not stated; no AUC is reported. The post describes LoLTheory as, 'primarily an Overwolf overlay app (~166,000 downloads)', and notes. Headline: 'On every one of these, LoLDraftAI beats LoLTheory.' A vendor's comparison against a rival, not an independent evaluation.

+6개 더 (세부 결과 모두 보기)
LoLDraftAI (side-agnostic mode)그 밖의 지표: 95% bootstrap CIs: log loss (0.6807–0.6842), accuracy (55.37–56.43), Brier (0.2439–0.2456)밴픽 후한 게임0.68240.24470.55900.0100높음나중 경기로 검증 · 데이터 전체 32,930경기, 테스트 비중 미기재시간순'LoLDraftAI training cutoff at 2026-04-17, 23:25 UTC — the latest game timestamp in the model's training data'; 'Eval set = matches played after both cutoffs.'32,930 matches; 'Eval set = matches played after both cutoffs'; exact dates and patches of the matches not stated (LoLTheory 'queried live on patch 16.8.1 during April 2026')
논문Online Game Outcome Prediction Model Using Weighted-Based Feature ApproachM. Asyhraf Zamir Zamri, Nurul Aswa Omar, Isredza Rahmi A. Hamid · Fusion: Practice and Applications, Vol. 15, No. 2, pp. 132-144 (2024) · 2024 (received 2023-08-12, revised 2023-12-25, accepted 2024-04-15) · 2026년 9월 22일 확인
메모

Sample counts disagree inside the paper (4,552 NA + 12,458 LAN; '12,458 samples... from Gonzalez'; 'a dataset of 28000 samples'). Each feature becomes a 1/0 'dominance' value ('If team A's performance is better than team B's for a feature, assign a value of 1; otherwise, assign 0'), and the text also says 'The feature's value indicator is a binary value of 1 if the blue team won and 0 if the blue team did not win'. The weights are computed from counts of 'data classified as 1' and 'data classified as 0' over the whole dataset, and the paper does not state that the 'class avg' and 'class med' accuracies are scored against the real match outcome; pregame is therefore 'unclear'. The paper frames the model for 'Solo Queue Ranked Match (SQRM)' but does not name its data's queue. F-measure values print between 4.0000 and 5.0160. Table 1's accuracy column is misaligned with the text (the text gives Lee et al. 62.26% at 5 minutes and 73% at 15, Silva et al. 63.91% and 83.54%, Ani et al. over 90%, Do et al. 75.10%, Gonzalez 82-90.48%); the cross-reports follow the text.

+4개 더 (세부 결과 모두 보기)
weighted-based feature predictor with Naïve Bayes and Support Vector Machine (WEKA BayesNet and SMO)그 밖의 지표: Conclusion밴픽 후한 게임>0.97낮음나중 경기로 검증하지 않음 · 데이터 전체 4,552경기, 테스트 비중 미기재무작위 분할다른 결과보다 훨씬 높음무작위(WEKA, Section 3.1)NA and LAN matches: (Gonzalez); Section 3.1 says 12,458 samples from Gonzalez were used, and Section 3.2 'a dataset of 28000 samples' partitioned into sizes 1000 to 7000 (results also shown at 12458); queue, tier and dates not stated
논문Player Skill Decomposition in Multiplayer Online Battle ArenasZhengxing Chen, Yizhou Sun, Magy Seif El-Nasr, Truong-Huy D. Nguyen · 2016 Meaningful Play Conference; arXiv:1702.06253 · 2017-02-21 (arXiv v1) · 2026년 9월 22일 확인
메모

The Dota 2 rows are the same paper's second dataset. Majority-class baseline (BL-MC): 53.22% ± 0.16% LoL, 52.65% ± 0.12% Dota 2.. The weights are learned from match outcomes, so under 10-fold CV a player's weight is fit on that player's other matches, earlier and later. The paper's significance rule: mean1 − mean2 > 2(std1 + std2).

+3개 더 (세부 결과 모두 보기)
LR-P-C-PC (player + champion + player-champion weights)그 밖의 지표: ± 0.16% (std over 10 folds)밴픽 후한 게임0.6024낮음나중 경기로 검증하지 않음 · 데이터 전체 231,212경기, 테스트 비중 미기재무작위 분할무작위10-fold CV over 231,212 unique ranked matches played in 2015 by 972 seed players of the top two tiers (Challenger and Master) on the North America server, through the official Riot API (93,098 players, 129 champions); the paper studies '5-vs-5 ranked matches of solo queue'
논문Using Machine Learning to Predict Game Outcomes Based on Player-Champion Experience in League of LegendsTiffany D. Do, Seong Ioi Wang, Dylan S. Yu, Matthew G. McMillian, Ryan P. McMahan · FDG 2021 (16th International Conference on the Foundations of Digital Games); arXiv:2108.02799 · 2021-08-05 (arXiv v1); FDG '21, August 3-6, 2021 · 2026년 9월 22일 확인
메모

Features as defined in the paper: champion mastery points ('lifetime experience'), player-champion win rate, season games on the champion, and ranked games on the champion within the last 20. The paper does not say whether the season aggregates were read before each match or at collection time. Other models in Table 1: RF 74.7%, SVC 74.3%, kNN 72.7% (kNN uses only 'the team's average win rate'). The authors prefer the DNN over GBOOST because GBOOST's standard error is much larger.

Deep neural network (5 dense layers)그 밖의 지표: ± 1.2% (95% CI); std. dev. 1.9%; std. error 0.60%밴픽 후한 게임0.751낮음나중 경기로 검증하지 않음 · 데이터 전체 5,000경기, 테스트 비중 미기재무작위 분할다른 결과보다 훨씬 높음무작위5,000 unique ranked matches from the North American server, 2020, ranks Iron to Diamond, pulled through the Riot API ; Table 1 gives each model's mean accuracy with a 95% CI, and the paper does not say whether that is the 10-fold mean or the 1,000-match test set
Using Machine Learning to Predict Game Outcomes Based on Player-Champion Experience in League of LegendsGradient boosting (GBOOST)그 밖의 지표: ± 1.19% (95% CI); std. dev. 5.25%; std. error 1.66%밴픽 후한 게임0.754낮음나중 경기로 검증하지 않음 · 데이터 전체 5,000경기, 테스트 비중 미기재무작위 분할다른 결과보다 훨씬 높음무작위5,000 unique ranked matches from the North American server, 2020, ranks Iron to Diamond, pulled through the Riot API ; Table 1 gives each model's mean accuracy with a 95% CI, and the paper does not say whether that is the 10-fold mean or the 1,000-match test set
웹사이트iTero vs LoLDraftAI: A Detailed ComparisonLoLDraftAI (no visible byline; site-wide HTML meta author 'looyyd') · loldraftai.com · 2026-04-19 ('April 19, 2026') · 2026년 9월 22일 확인
메모

Full tournament data published as drafts_scored.jsonl (exists; not downloaded). The post infers iTero's model ('consistent with a gradient-boosted tree ensemble over lolalytics-style aggregates') from 'its API response signature'; that is a rival's inference, not iTero's statement. Its feature table says iTero offers 'per-candidate score only; no team WR', which is why no calibrated metric could be scored for iTero. No real match outcomes are involved, so none of these numbers is a forecast score.

LoLDraftAI (as drafter) — judge: DraftGap (third-party)그 밖의 지표: LoLDraftAI win rate 55.0% (45.0–65.0); Mean WR margin (LoLDraftAI) +0.6% (−1.0 to +2.2)밴픽 후한 게임낮음나중 경기로 검증하지 않음 · 데이터 전체 100경기, 테스트 비중 미기재 · 알려진 문제실제 결과 없음분리된 테스트 없음작은 테스트분리된 테스트 없음none: no games are played; 100 synthetic greedy drafts are scored by a judge model's predicted win rate100 head-to-head greedy drafts; patch and date not stated
iTero vs LoLDraftAI: A Detailed ComparisonLoLDraftAI (as drafter) — judge: LoLDraftAI's own win-probability head (flagged non-independent)그 밖의 지표: LoLDraftAI win rate 93.0% (88.0–98.0); Mean WR margin (LoLDraftAI) +13.2% (+11.6 to +14.9)밴픽 후한 게임낮음나중 경기로 검증하지 않음 · 데이터 전체 100경기, 테스트 비중 미기재 · 알려진 문제실제 결과 없음분리된 테스트 없음작은 테스트분리된 테스트 없음none: the judge is the same model that drafted ('LoLDraftAI judging drafts it itself picked is textbook circular')the same 100 drafts
iTero vs LoLDraftAI: A Detailed ComparisonLoLDraftAI (predicted gold at 15 min) against the two judges' disagreement — judge disagreement analysis그 밖의 지표: Pearson r = +0.59 (n = 100); Mean |LoLDraftAI − DraftGap| by predicted gold@15 quartile: Q1 32 – 497 g (n 25) 10.4 pp; Q2 497 – 1,108 g (25) 13.3 pp; Q3 1,108 – 2,162 g (25) 12.6 pp; Q4 2,162 – 4,882 g (25) 14.8 pp밴픽 후한 게임낮음나중 경기로 검증하지 않음 · 데이터 전체 100경기, 테스트 비중 미기재 · 알려진 문제실제 결과 없음분리된 테스트 없음작은 테스트분리된 테스트 없음nonethe same 100 drafts
웹사이트【LoL】AIがドラフト前にプレイヤー情報だけで76.7%の精度で勝敗予測的中 – MMRは本当に機能しているのか? (lolninja.net report of the Reddit post 'AI can predict the winner of 76.7% of your games before draft even begins! Is the MMR system broken?')いちずなイブリン (lolninja.net), reporting a Reddit user's post · lolninja.net · 2025-04-23 ('2025.04.23') · 2026년 9월 22일 확인
메모

Secondary source: it relays the Reddit post https://www.reddit.com/r/leagueoflegends/comments/1k5hmlf/ai_can_predict_the_winner_of_767_of_your_games/ (not read; Reddit is unreachable to the fetcher). pregame is 'unclear' because the rank feature is taken after the games were played.

Reddit poster's neural net, rank + draft밴픽 후한 게임0.747낮음분할 방법 미기재 · 데이터 전체 21,000경기, 테스트 비중 미기재 · 알려진 문제누수 인정분할 방법 미기재미기재'80/10/10分割' (an 80/10/10 split); whether random, temporal or by player is not statedabout 21,000 matches after cleaning (15,000 solo queue, 2,000 flex, 4,000 normal draft) from about 30,000 collected; players 'randomly' gathered from Gold/Platinum; NA; patch 15.7; test-set size not stated
【LoL】AIがドラフト前にプレイヤー情報だけで76.7%の精度で勝敗予測的中 – MMRは本当に機能しているのか? (lolninja.net report of the Reddit post 'AI can predict the winner of 76.7% of your games before draft even begins! Is the MMR system broken?')Reddit poster's neural net, draft only밴픽 후한 게임0.528알 수 없음분할 방법 미기재 · 데이터 전체 21,000경기, 테스트 비중 미기재분할 방법 미기재미기재'80/10/10分割' (an 80/10/10 split); whether random, temporal or by player is not statedabout 21,000 matches after cleaning (15,000 solo queue, 2,000 flex, 4,000 normal draft) from about 30,000 collected; players 'randomly' gathered from Gold/Platinum; NA; patch 15.7; test-set size not stated
웹사이트Bugfix and Correction of Reddit Post Accuracy Claims (blog index title: 'Correction: Reddit Post Accuracy Claims')LoLDraftAI (first person, no visible byline; site-wide HTML meta author 'looyyd') · loldraftai.com · 2025-04-07 ('April 7, 2025') · 2026년 9월 22일 확인
메모

Retracted Reddit post: https://www.reddit.com/r/leagueoflegends/comments/1joumtm/i_made_an_ai_model_that_predicts_62_of_ranked/ (not read; Reddit is unreachable to the fetcher). The author thanks '/u/Impossible_Concert88 for trying to verify the accuracy claims' and writes: Queue: the post says 'ranked' (from the Reddit title) without naming solo/duo; level set to solo queue on that basis.

+2개 더 (세부 결과 모두 보기)
LoLDraftAI, fixed model uploaded April 4, 2025그 밖의 지표: 'around 55% (as of April 4 2025)'밴픽 후한 게임0.55알 수 없음분할 방법 미기재 · 테스트 크기 미기재분할 방법 미기재미기재not stated (validation set after the duplication fix; construction not described)not stated
웹사이트How it Works: LoLDraftAILoLDraftAI (no visible byline; site-wide HTML meta author 'looyyd') · loldraftai.com · 2025-09-04 ('September 4, 2025') · 2026년 9월 22일 확인
메모

Training logs linked from the post (not opened here): solo queue https://wandb.ai/loyd-team/draftking/runs/jy5hf0bv?panelDisplayName=val_win_prediction_accuracy&panelSectionName=Charts; pro play https://wandb.ai/loyd-team/draftking-pro-finetune/runs/jg3ls0xp?panelDisplayName=val_pro_win_prediction_accuracy&panelSectionName=Charts. 'We mask randomly because the riot data doesn't have information about the original pick order'... 'the model is not aware of "blind pickability".' The page header 'Last model update: September 19 on patch 16.18' is the site-wide banner for the current model, not the one the post describes.

+1개 더 (세부 결과 모두 보기)
LoLDraftAI solo queue and pro play models (the training-log links point to the May 2025 model)밴픽 후한 게임0.56알 수 없음분할 방법 미기재 · 테스트 크기 미기재분할 방법 미기재미기재'on random drafts they have not been trained on' — read from 'the training logs' (Weights & Biases panels val_win_prediction_accuracy / val_pro_win_prediction_accuracy); how the held-out drafts were separated is not statednot stated (held-out drafts from the training runs; no dates, regions, elo range or n)
웹사이트LoLDraftAI homepage: headline stat block and FAQ 'How accurate is the model?'LoLDraftAI (site-wide HTML meta author 'looyyd') · loldraftai.com · not stated; page stamped 'Patch 16.18 · Updated September 19' and 'Last model update: September 19 on patch 16.18' · 2026년 9월 22일 확인
메모

FAQ answer in full: No test set, split, n, curve or ECE is given anywhere on the page. The landing page also shows 'Outperforms DraftGap · Outperforms iTero · Outperforms LoLTheory' badges and a 'Side by side' table whose 'Calibrated win %' row gives LoLDraftAI a check and DraftGap, iTero and LoLTheory a '?'; no metric is attached, so no cross-report is recorded. 'Read the full breakdowns' links to the three comparison posts. Other page claims: 'Re-trained weekly', and.

+1개 더 (세부 결과 모두 보기)
LoLDraftAI (draft only)그 밖의 지표: Calibrated · 55% means 55%밴픽 후한 게임0.567알 수 없음분할 방법 미기재 · 테스트 크기 미기재분할 방법 미기재미기재not statednot stated (the page says 'Silver to Challenger' and 'Trained on millions of ranked games' but gives no test set, dates, region or n for the 56.7%)
LoLDraftAI homepage: headline stat block and FAQ 'How accurate is the model?'LoLDraftAI with runes밴픽 후한 게임0.577알 수 없음분할 방법 미기재 · 테스트 크기 미기재분할 방법 미기재미기재not statednot stated
논문Predicting League of Legends Match Outcomes Through Machine Learning Models Using Past Match Player PerformanceChaim Joseph A. Cordova, Carl Victor A. Villaceran, Christine F. Peña · 2024 IEEE International Conference on Computing (ICOCO) · 2024-12-12 · 2026년 9월 22일 확인
메모

. The abstract does not say how the data were split or whether the win rates exclude the predicted match. Queue not named ('ranked matches').

Gradient Boosting, Logistic Regression and Deep Neural Networks (reported together)밴픽 후한 게임0.975알 수 없음분할 방법 미기재 · 데이터 전체 11,000경기, 테스트 비중 미기재분할 방법 미기재다른 결과보다 훨씬 높음미기재not stated in the abstract'over 11,000 ranked matches' (abstract); source, region, tier and dates not stated
논문Scalable Psychological Momentum Forecasting in EsportsAlfonso White, Daniela M. Romano · SUM '20 (State-based User Modelling) workshop at WSDM 2020; arXiv:2001.11274 · 2020-01-30 (arXiv v1; v2 2020-02-15); SUM '20, February 3-7, 2020 · 2026년 9월 22일 확인
메모

Other Table 3 rows (test %): post-draft AutoLog+Rolling+LR 72.0, AutoLog+LR 71.8, Loginit+Rolling+(momentum)+LR 70.8, Rolling+(momentum)+LR 68.8, LR baseline 68.3; pre-draft teams AutoLog+Rolling+LR 65.6, AutoLog+LR 65.1, LR baseline 62.3, MTL+RNN 61.6; pre-draft solo AutoLog+Rolling+LR 54.03, AutoLog+LR 53.59, LR baseline 53.38, AutoLog+MTL-TL+RNN 52.48, AutoLog+RNN 52.38. Participant profiles were loaded from op.gg 'Once a valid match is found' (season totals and up to the last 20 games); the paper does not say they exclude the target match. Stated limitation.

+1개 더 (세부 결과 모두 보기)
AutoLog+Rolling+(momentum)+LR (post-draft)그 밖의 지표: train accuracy 73.6%; train n 70,194밴픽 후한 게임0.721알 수 없음분할 방법 미기재 · 테스트 10,000경기분할 방법 미기재미기재10,000 test matches out of 87,743 collected 'from February 5th to September 20th of 2019' (86.4% Solo/Duo queue, 13.6% Flex; 517,269 unique summoners), crawled through the Riot Games API with op.gg profile summaries and champion.gg / op.gg averages; region not stated; how the 10,000 were drawn is not stated
논문Strategic Feature Selection for Draft Prediction in League of LegendsManaschai Aonon, Ponguthai Samrankhong, Teerawat Kamnardsiri · 2026 Joint International Conference on Digital Arts, Media and Technology with ECTI Northern Section Conference (ECTI DAMT & NCON) · 2026-02-04 · 2026년 9월 22일 확인
메모

Feature importance per the abstract: meta strength 26.3%, team synergy 24.8%, counter-matchups 20.6%, runes and spells 6.7% combined.

LightGBM (best of 20 algorithms)그 밖의 지표: 'minimal generalization gap (0.27%)'밴픽 후한 게임0.9220.831알 수 없음분할 방법 미기재 · 데이터 전체 86,556경기, 테스트 비중 미기재분할 방법 미기재다른 결과보다 훨씬 높음미기재not stated in the abstract (it reports 'test accuracy')'86,556 high-level matches' (abstract); source, region and dates not stated

밴픽 중 5

아직 가려진 픽이 있습니다. 저희의 세 밴픽 중 모델이 있는 곳.

기본 순서: 저희 행, 그다음 가장 잘 검증된 순서. 제목을 누르면 정렬됩니다.
모델 또는 설정검증 데이터
KayLoL웹사이트KayLoL /metrics, layer 1: the held-out patchKayLoL · kaylol.gg · 2026-09-09 build (live payload generated 2026-09-23T01:22:01Z) · 2026년 9월 23일 확인
메모

A second layer on the same page scores every day's games with a model frozen before that day (1.9M predictions per mode, na1, 2026-08-27 onward) and agrees with these within 0.004 on every metric.

draft_all_puuid — mid-draft, all ten players identified (clash / organised draft)밴픽 중한 게임0.63450.66350.23570.59500.0035높음나중 경기로 검증 · 테스트 1,164,446경기시간순whole-patch holdout: trained on patches 16.13-16.16, tested on 16.17, which the model never sawNA ranked solo queue (na1), all tiers; patch 16.17, 2026-08-26 to 09-09; 1,164,446 held-out games, scored on the validation half
KayLoL /metrics, layer 1: the held-out patchdraft_puuid — mid-draft, own identity plus revealed picks (solo-queue champion select)밴픽 중한 게임0.56420.68640.24670.54460.0041높음나중 경기로 검증 · 테스트 1,164,446경기시간순whole-patch holdout: trained on patches 16.13-16.16, tested on 16.17, which the model never sawNA ranked solo queue (na1), all tiers; patch 16.17, 2026-08-26 to 09-09; 1,164,446 held-out games, scored on the validation half
KayLoL /metrics, layer 1: the held-out patchdraft_anonymous — mid-draft, no identities밴픽 중한 게임0.54950.68880.24790.53310.0042높음나중 경기로 검증 · 테스트 1,164,446경기시간순whole-patch holdout: trained on patches 16.13-16.16, tested on 16.17, which the model never sawNA ranked solo queue (na1), all tiers; patch 16.17, 2026-08-26 to 09-09; 1,164,446 held-out games, scored on the validation half
논문DraftRec: Personalized Draft Recommendation for Winning in Multi-Player Online Battle Arena GamesHojoon Lee, Dongyoon Hwang, Hyunseung Kim, Byungkun Lee, Jaegul Choo · WWW 2022 (The ACM Web Conference); arXiv:2204.12750 · 2022-04-27 (arXiv v1, 'Accepted to WWW 2022') · 2026년 9월 22일 확인
메모

The Dota 2 rows are the same paper's second dataset (Dota 2 is not this file's game). Generic baselines in the same tables, not listed above: MC (majority class, 'Blue for LOL and Radiant for Dota2') 0.5040 LoL and 0.5180 Dota 2; LR 0.5255 during and 0.5323 after the draft (LoL), 0.5750 and 0.6126 (Dota 2); NN 0.5263 and 0.5335 (LoL), 0.5748 and 0.6108 (Dota 2). After the Dota 2 draft, LR (0.6126) prints above DraftRec (0.6110). Outcome prediction is the paper's secondary task; its main task is champion recommendation. Code and data: github.com/dojeon-ai/DraftRec.

+1개 더 (세부 결과 모두 보기)
DraftRec (LoL, during the draft)그 밖의 지표: MAE 0.4842 (accuracy and MAE both starred: p<0.01)밴픽 중한 게임0.5535높음나중 경기로 검증 · 테스트 약 27,989경기시간순Last 10% by time of 279,893 LoL matches collected through the Riot Games API: (62,466 players); region and queue not stated; test-set size not stated
웹사이트+4% to +7%: How Much the Top Suggestion Helps, by Counterpick SkillLoLDraftAI (no visible byline; site-wide HTML meta author 'looyyd') · loldraftai.com · 2026-04-28 ('April 28, 2026') · 2026년 9월 22일 확인
메모

'This is model-predicted lift, not measured outcomes' — the model scores its own suggestions; no game result enters these numbers. Naive baseline: 'uniformly at random among the revealed slots'; strongest-visible. The model 'implicitly assume[s] the opponent's downstream picks don't change in response to ours'. Only Bottom and Utility (roles) and Silver and Master+ (elo) are broken out in the text; no overall average is printed. This study is the source of the homepage's '+4–7%'.

+11개 더 (세부 결과 모두 보기)
LoLDraftAI top suggestion (model-predicted lift, self-scored) — pick 1 (Blue, 0 visible picks)그 밖의 지표: lift vs naive baseline +3.0%; lift vs strongest-visible baseline +3.0%밴픽 중한 게임낮음분할 방법 미기재 · 데이터 전체 10,000경기, 테스트 비중 미기재 · 알려진 문제실제 결과 없음분할 방법 미기재미기재how that test set was held out is not stated10,000 ranked games
+4% to +7%: How Much the Top Suggestion Helps, by Counterpick SkillLoLDraftAI top suggestion (model-predicted lift, self-scored) — pick 2 (Red, 1 visible picks)그 밖의 지표: lift vs naive baseline +3.8%; lift vs strongest-visible baseline +3.8%밴픽 중한 게임낮음분할 방법 미기재 · 데이터 전체 10,000경기, 테스트 비중 미기재 · 알려진 문제실제 결과 없음분할 방법 미기재미기재how that test set was held out is not stated10,000 ranked games
+4% to +7%: How Much the Top Suggestion Helps, by Counterpick SkillLoLDraftAI top suggestion (model-predicted lift, self-scored) — pick 3 (Red, 2 visible picks)그 밖의 지표: lift vs naive baseline +4.1%; lift vs strongest-visible baseline +3.5%밴픽 중한 게임낮음분할 방법 미기재 · 데이터 전체 10,000경기, 테스트 비중 미기재 · 알려진 문제실제 결과 없음분할 방법 미기재미기재how that test set was held out is not stated10,000 ranked games
코드LeagueOfPredictions: Predictive Analytics for League of Legendsaliciusschroeder (GitHub) · GitHub · README undated; repo created 2023-05-17, last push 2024-10-15 (GitHub API) · 2026년 9월 22일 확인
메모

Level set to solo queue from 'ranked games in silver elo' (queue not named). 'still in the experimental phase'. Code not audited here; whether any input leaks the outcome is not answerable from the README.

LeagueOfPredictions model밴픽 중한 게임0.879알 수 없음분할 방법 미기재 · 데이터 전체 300,000경기, 테스트 비중 미기재분할 방법 미기재다른 결과보다 훨씬 높음미기재not stated (README names train.py and validate.py but no protocol)not stated beyond 'trained the model on 300,000 datasets' and 'ranked games in silver elo'; region, queue, patch and dates not stated
웹사이트What's the Best League of Legends Draft AI?Winrate (winrate.gg; no named author) · winrate.gg · 2026-04-28 ('April 28, 2026') · 2026년 9월 22일 확인
메모

'This is a correlation, not a causal experiment. We didn't tell anyone to follow the recommendation.' 'That's a 5.4-point spread between top and bottom' (Top 10). DraftGap left out ('static aggregate stats... rather than a learned model'); LoLTheory left out ('LoLDraftAI published a head-to-head where they outperformed it'). The article describes iTero's model as 'gradient-boosted trees with linear models'. Only the anonymous winrate.gg model was tested; the personalized model (~40 more features) was not. The realized win rate is not an accuracy, so the five metric fields are null.

저희 확인: The article does not say whether the statistics behind winrate.gg's own suggestions excluded the 12 hours of games being tested.

+1개 더 (세부 결과 모두 보기)
Winrate anonymous draft model (GBDT, 58 features) — Top 1그 밖의 지표: realized win rate when the actual pick was in the tool's Top 1: 58.7% (n 300)밴픽 중한 게임알 수 없음분할 방법 미기재 · 데이터 전체 20,000경기, 테스트 비중 미기재분할 방법 미기재미기재Test games are the ranked games of the 12 hours before the query ('match_timestamp >= toUnixTimestamp64Milli(now64 - INTERVAL 12 HOUR)'); the article does not say whether winrate.gg's model or its champion aggregates had already seen those games20,000 'real ranked solo-queue games (queue 420)', 'Gold tier and above', 'Recent live patches', both teams' five roles assigned, from the 12 hours before the query ('ORDER BY sipHash64(match_id) LIMIT 20000'); one champion erased per game, nine visible; region not stated; 'n is the number of games where the actual pick was in the site's Top K'
What's the Best League of Legends Draft AI?Winrate anonymous draft model (GBDT, 58 features) — Top 3그 밖의 지표: realized win rate when the actual pick was in the tool's Top 3: 56.0% (n 1,131)밴픽 중한 게임알 수 없음분할 방법 미기재 · 데이터 전체 20,000경기, 테스트 비중 미기재분할 방법 미기재미기재Test games are the ranked games of the 12 hours before the query ('match_timestamp >= toUnixTimestamp64Milli(now64 - INTERVAL 12 HOUR)'); the article does not say whether winrate.gg's model or its champion aggregates had already seen those games20,000 'real ranked solo-queue games (queue 420)', 'Gold tier and above', 'Recent live patches', both teams' five roles assigned, from the 12 hours before the query ('ORDER BY sipHash64(match_id) LIMIT 20000'); one champion erased per game, nine visible; region not stated; 'n is the number of games where the actual pick was in the site's Top K'
What's the Best League of Legends Draft AI?Winrate anonymous draft model (GBDT, 58 features) — Top 5그 밖의 지표: realized win rate when the actual pick was in the tool's Top 5: 55.2% (n 2,004)밴픽 중한 게임알 수 없음분할 방법 미기재 · 데이터 전체 20,000경기, 테스트 비중 미기재분할 방법 미기재미기재Test games are the ranked games of the 12 hours before the query ('match_timestamp >= toUnixTimestamp64Milli(now64 - INTERVAL 12 HOUR)'); the article does not say whether winrate.gg's model or its champion aggregates had already seen those games20,000 'real ranked solo-queue games (queue 420)', 'Gold tier and above', 'Recent live patches', both teams' five roles assigned, from the 12 hours before the query ('ORDER BY sipHash64(match_id) LIMIT 20000'); one champion erased per game, nine visible; region not stated; 'n is the number of games where the actual pick was in the site's Top K'

밴픽 전 3

플레이어는 알지만 챔피언은 모르는 시점.

기본 순서: 저희 행, 그다음 가장 잘 검증된 순서. 제목을 누르면 정렬됩니다.
모델 또는 설정검증 데이터
웹사이트【LoL】AIがドラフト前にプレイヤー情報だけで76.7%の精度で勝敗予測的中 – MMRは本当に機能しているのか? (lolninja.net report of the Reddit post 'AI can predict the winner of 76.7% of your games before draft even begins! Is the MMR system broken?')いちずなイブリン (lolninja.net), reporting a Reddit user's post · lolninja.net · 2025-04-23 ('2025.04.23') · 2026년 9월 22일 확인
메모

Secondary source: it relays the Reddit post https://www.reddit.com/r/leagueoflegends/comments/1k5hmlf/ai_can_predict_the_winner_of_767_of_your_games/ (not read; Reddit is unreachable to the fetcher). pregame is 'unclear' because the rank feature is taken after the games were played.

Reddit poster's neural net, rank only밴픽 전한 게임0.767낮음분할 방법 미기재 · 데이터 전체 21,000경기, 테스트 비중 미기재 · 알려진 문제누수 인정분할 방법 미기재다른 결과보다 훨씬 높음미기재'80/10/10分割' (an 80/10/10 split); whether random, temporal or by player is not statedabout 21,000 matches after cleaning (15,000 solo queue, 2,000 flex, 4,000 normal draft) from about 30,000 collected; players 'randomly' gathered from Gold/Platinum; NA; patch 15.7; test-set size not stated
코드league_winrate_model ('Source code for Reddit post')ksavino1 (GitHub) · GitHub · 2025-04-22 (repo created; last push 2025-06-07, GitHub API) · 2026년 9월 22일 확인
메모

README... Found via the lolninja.net article's code link; one fetch only, not chased further. The two players' profile links in the README are left out here.

rank-based model from the Reddit post — re-check on fresh games with rank at game time그 밖의 지표: 23/30 right; one tailed p = 0.002611밴픽 전한 게임알 수 없음분할 방법 미기재 · 테스트 크기 미기재분할 방법 미기재미기재fresh games scored with op.gg ranks 'at time the game happened, not current ranks'; relation to the training data not stated30 solo/duo games of two players
논문Scalable Psychological Momentum Forecasting in EsportsAlfonso White, Daniela M. Romano · SUM '20 (State-based User Modelling) workshop at WSDM 2020; arXiv:2001.11274 · 2020-01-30 (arXiv v1; v2 2020-02-15); SUM '20, February 3-7, 2020 · 2026년 9월 22일 확인
메모

Other Table 3 rows (test %): post-draft AutoLog+Rolling+LR 72.0, AutoLog+LR 71.8, Loginit+Rolling+(momentum)+LR 70.8, Rolling+(momentum)+LR 68.8, LR baseline 68.3; pre-draft teams AutoLog+Rolling+LR 65.6, AutoLog+LR 65.1, LR baseline 62.3, MTL+RNN 61.6; pre-draft solo AutoLog+Rolling+LR 54.03, AutoLog+LR 53.59, LR baseline 53.38, AutoLog+MTL-TL+RNN 52.48, AutoLog+RNN 52.38. Participant profiles were loaded from op.gg 'Once a valid match is found' (season totals and up to the last 20 games); the paper does not say they exclude the target match. Stated limitation.

+1개 더 (세부 결과 모두 보기)
AutoLog+Rolling+(momentum)+LR — pre-draft, teams그 밖의 지표: train accuracy 66.8%; train n 70,194밴픽 전한 게임0.657알 수 없음분할 방법 미기재 · 테스트 10,000경기분할 방법 미기재미기재10,000 test matches out of 87,743 collected 'from February 5th to September 20th of 2019' (86.4% Solo/Duo queue, 13.6% Flex; 517,269 unique summoners), crawled through the Riot Games API with op.gg profile summaries and champion.gg / op.gg averages; region not stated; how the 10,000 were drawn is not stated
Scalable Psychological Momentum Forecasting in EsportsAutoLog+MTL+RNN — pre-draft, teams그 밖의 지표: train accuracy 64.5%; train n 70,194밴픽 전한 게임0.644알 수 없음분할 방법 미기재 · 테스트 10,000경기분할 방법 미기재미기재10,000 test matches out of 87,743 collected 'from February 5th to September 20th of 2019' (86.4% Solo/Duo queue, 13.6% Flex; 517,269 unique summoners), crawled through the Riot Games API with op.gg profile summaries and champion.gg / op.gg averages; region not stated; how the 10,000 were drawn is not stated
Scalable Psychological Momentum Forecasting in EsportsAutoLog+Rolling+(momentum)+RNN — pre-draft, single player in queue그 밖의 지표: train accuracy 54.36%; train n 701,940밴픽 전한 게임0.5430알 수 없음분할 방법 미기재 · 테스트 크기 미기재분할 방법 미기재미기재Single-player samples from the 701,940 individual match histories, 'within the same folds', of the same 2019 collection; test size not stated

승률은 보여 주지만 검증은 공개하지 않음

승리 확률을 보여 주지만, 저희가 찾은 한 그 검증 결과를 공개하지 않는 도구들.

  • How the Draft Model Works (winrate.gg)Publishes no accuracy, AUC, log loss, Brier or calibration figure for its own win model (checked 2026-09-22; also the homepage, the articles index and 'Measuring What Matters: From Stats to Win Probability', 2026-02-04, which has none). Training; 'we don't have the actual pick order'. The only evaluation winrate.gg publishes is the 2026-04-28 recommender benchmark (winrate-gg-draft-ai-benchmark-2026-04).
  • Global Power Rankings 2026 page and the Worlds 2025 primer's GPR changesNo accuracy, Brier or log loss is published for the revised system (checked 2026-09-22 on the 2026 GPR page and https://lolesports.com/en-US/news/worlds-2025-primer). The primer: 'daily updates rolling out after each match day' and. The 2026 page's 'More Info' link goes to the 2024 dev diary, whose 65% describes the earlier 80/20 system. Agrees with sources.md and benchmarks.md.
  • LoL: Can Solo Queue data be used for Professional playNo accuracy, AUC, log loss or Brier for any iTero model: the post says its model became 'significantly more accurate' with solo-queue data and is 'evaluated on how accurately it predicts future games', without a number (checked 2026-09-22).
  • iTero homepagePublishes no accuracy or evaluation claim for its own model (checked 2026-09-22). The page shows '+1,000,000 Downloads', '4.4 Ratings' and user testimonials (e.g. 'My winrate has improved to 65% in 105 games'), which are user anecdotes, not an evaluation. iTero is measured only by rivals: loldraftai-vs-itero-2026-04 and winrate-gg-draft-ai-benchmark-2026-04.
  • PropsBot.AI: track record and LoL predictions pageNon-MOBA figures on the track-record page, recorded here only as context: NFL '13.7% ROI on 8,210 graded NFL picks' (56.9% win rate) and '73.2% win rate on 20,222 graded NFL picks' (−2.0% ROI); NBA '25.9% ROI on 81,410 graded NBA picks' (47.1% win rate); MLB 'Brier 0.1903 vs Vegas 0.1947'. Logging: Shows no LoL win % record and publishes no LoL evaluation (checked 2026-09-22).
  • sport.gg: League of Legends predictionsShows win probabilities but publishes no track record, accuracy, Brier or log loss (checked 2026-09-22). It states a calibration goal and that 'For best-of-five series, probabilities are tighter than best-of-one matches'. Matches comparison-protocol.md §8b.
  • DraftGap (GitHub README and draftgap.com)Publishes no evaluation of itself (checked 2026-09-22): the README is seven lines with no metric, the repository holds no other documentation besides AGENTS.md, and draftgap.com returned only a title to the fetcher. Its formula produces a draft win rate, which LoLDraftAI scored in loldraftai-vs-draftgap-2026-04 (the only published evaluation of DraftGap).
  • LoLTheory (loltheory.gg)Publishes no evaluation of itself on its site (checked 2026-09-22): the homepage shows '90K+ downloads' and no accuracy, calibration or model-documentation link, and no draft win % on the page read. LoLDraftAI's comparison post says LoLTheory's developer ('Griffin') stated a '54–56% range' on Reddit; recorded as a cross-report in loldraftai-vs-loltheory-2026-04, not verified (Reddit not read).
  • LOL Brain (lol-brain.com)Shows a win % but publishes no evaluation (checked 2026-09-22); the draft calculator on the page displays a sample 'Win Probability' of 54% against 46%.
  • Smartpick (smartpick.gg)Publishes no evaluation (checked 2026-09-22); the page read showed no win % either, only the slogan 'Smarter picks, stronger drafts, higher win rates'.
  • Draft Genius (draftgenius.lol)Shows a win % but publishes no evaluation (checked 2026-09-22); the page displays a draft win-probability bar ('50.0 Ally' / '50.0 Enemy' in the empty state).
  • Baron Buff (baronbuff.com)Publishes no evaluation (checked 2026-09-22); the page read does not show a draft win %.
  • DraftForge (draftforge.gg)Publishes no evaluation (checked 2026-09-22); the page read does not show a draft win %, and its only quantified claim is the 200,000+ pairs it draws on.
  • Drafter.one ('The First League of Legends Drafting Game'; model 'DrafterEye')drafter.one and drafter.one/game return only a title to the fetcher. A search-engine summary (secondary, unverified, apparently from the product's X account @Drafter_GG) says 'Drafter's algorithm achieved a 71% prediction rate during the knock out stage' and '71% prediction on Worlds games (5/7)'; the 2026-09-11 survey logged the same '71% prediction rate' as a search snippet. Not recorded as a metric until read at the source.