Model 4 preliminary evaluation

Static snapshot for sharing (no user_id). Source: fraud_report.ml_requests. Cache built: 2026-10-13T16:38:26. CB user = lifetime user_id IN fraud.cb_payments. Scores > 1 ignored here (394 rows remain in the table).

Overview

Txns

1,355,474

Users

183,785

CB users

6,632

Txn CBs

Mean score

0.0212

Status=1 txns

1,037,860

created_at 2026-09-02 12:43:40.316000 → 2026-10-12 18:56:56.605000

Score distributions: CB users vs non-CB users

One row per user. Mean / median / max of that user’s model-4 txn scores (scores in (0, 1]). Histograms are binned; individual scores are not published.

CB users mean

0.0230

Non-CB users mean

0.0186

CB users median

0.0073

Non-CB users median

0.0076

CB mean of maxes

0.0367

Non-CB mean of maxes

0.0291

CB users

Non-CB users

level_0	level_1	non-CB users	CB users
mean_score	count	177,153	6,632
mean_score	mean	0.0186	0.0230
mean_score	std	0.0310	0.0409
mean_score	min	-0.0094	-0.0021
mean_score	25%	0.0047	0.0044
mean_score	50%	0.0081	0.0078
mean_score	75%	0.0171	0.0198
mean_score	max	0.5955	0.5042
median_score	count	177,153	6,632
median_score	mean	0.0176	0.0220
median_score	std	0.0309	0.0416
median_score	min	-0.0067	-0.0021
median_score	25%	0.0044	0.0041
median_score	50%	0.0076	0.0073
median_score	75%	0.0154	0.0166
median_score	max	0.5939	0.5042
max_score	count	177,153	6,632
max_score	mean	0.0291	0.0367
max_score	std	0.0484	0.0597
max_score	min	-0.0036	-0.0021
max_score	25%	0.0062	0.0063
max_score	50%	0.0111	0.0116
max_score	75%	0.0271	0.0392
max_score	max	0.6539	0.5042
n_txns	count	177,153	6,632
n_txns	mean	7.2459	11
n_txns	std	13	20
n_txns	min	1.0000	1.0000
n_txns	25%	2.0000	2.0000
n_txns	50%	4.0000	5.0000
n_txns	75%	8.0000	12
n_txns	max	1,018	515
amt	count	177,153	6,632
amt	mean	919	2,014
amt	std	8,248	9,665
amt	min	10	10
amt	25%	110	190
amt	50%	300	490
amt	75%	700	1,235
amt	max	1,626,443	402,311

Raw txn scores (all txns)

Every scored txn is one observation. CB vs non-CB follows the user, not a txn-level chargeback flag.

CB n · all txns

71,849

CB mean / median

0.0179 / 0.0000

Non-CB n · all txns

1,283,625

Non-CB mean / median

0.0165 / 0.0000

CB user txns — all txns

Non-CB user txns — all txns

Raw txn scores > 0.1 (all txns)

TRUNCATE(score, 2) > 0.1 (score ≥ 0.11). Share is renormalized inside this subset.

CB n · all txns, score > 0.1

3,201

CB mean / median

0.1725 / 0.1500

Non-CB n · all txns, score > 0.1

45,914

Non-CB mean / median

0.1724 / 0.1500

CB user txns — all txns, score > 0.1

Non-CB user txns — all txns, score > 0.1

transaction_status = 1 only

Successful payments (tbl_siftfrauddata.transaction_status = 1, joined on sift id = ml_requests.transaction_id).

Status=1 txns

1,037,860

Status=1 from CB users

43,881

Status=1 from non-CB users

993,979

CB n · status=1

43,881

CB mean / median

0.0093 / 0.0000

Non-CB n · status=1

993,979

Non-CB mean / median

0.0140 / 0.0000

CB user txns — status=1

Non-CB user txns — status=1

Status=1 scores > 0.1

Successful payments with TRUNCATE(score, 2) > 0.1.

CB n · status=1, score > 0.1

703

CB mean / median

0.1566 / 0.1300

Non-CB n · status=1, score > 0.1

27,517

Non-CB mean / median

0.1705 / 0.1500

CB user txns — status=1, score > 0.1

Non-CB user txns — status=1, score > 0.1

Status=1, not 3DS

Successful payments joined ml_requests.transaction_id = tbl_siftfrauddata.id and tbl_siftfrauddata.transactionid = tbl_payments.id, then json_variables LIKE '%3d_s%' IS NOT TRUE (NULL json_variables counts as not-3DS).

Status=1 not-3DS

1,031,042

from CB users

42,963

from non-CB users

988,079

CB n · status=1, not 3DS

42,963

CB mean / median

0.0090 / 0.0000

Non-CB n · status=1, not 3DS

988,079

Non-CB mean / median

0.0139 / 0.0000

CB user txns — status=1, not 3DS

Non-CB user txns — status=1, not 3DS

Status=1, not 3DS, scores > 0.1

Same non-3DS successful-payment universe, TRUNCATE(score, 2) > 0.1.

CB n · status=1 not-3DS, score > 0.1

651

CB mean / median

0.1548 / 0.1300

Non-CB n · status=1 not-3DS, score > 0.1

26,837

Non-CB mean / median

0.1702 / 0.1500

CB user txns — status=1 not-3DS, score > 0.1

Non-CB user txns — status=1 not-3DS, score > 0.1

Score bins vs chargebacks

cum_cb_user_amt is the ticket sum of CB-user txns with score ≥ that bin.

Txn-level CB

bin_start	pct_cb_amt_flagged	pct_noncb_amt_spared	cum_cb_user_amt	noncb_amt	spared_non_cb_amount	tot_txns	total_cb_users_txns	avg_pred	user_cb_perc	tot_txns_amt	tot_cb_user_amt	cum_cb_user_txns	cum_txns_ge	cum_txns_amt_ge	tot_noncb_amt	cum_noncb_amt
-0.0100	100.0%	0.0%	13,354,270	162,783,167	0.0000	1	0.0000	-0.0178	0.0000	4,423	0.0000	71,849	1,355,474	176,137,437	4,423	162,783,167
0.0000	100.0%	0.0%	13,354,270	162,778,744	4,423	799,748	43,895	0.0049	0.0549	106,271,962	7,237,811	71,849	1,355,473	176,133,014	99,034,152	162,778,744
0.0100	45.8%	60.8%	6,116,459	63,744,592	99,038,575	245,592	11,462	0.0138	0.0467	28,481,683	2,000,916	27,954	555,725	69,861,051	26,480,768	63,744,592
0.0200	30.8%	77.1%	4,115,543	37,263,825	125,519,342	76,120	3,655	0.0243	0.0480	9,697,427	756,463	16,492	310,133	41,379,368	8,940,964	37,263,825
0.0300	25.2%	82.6%	3,359,080	28,322,860	134,460,307	43,501	1,917	0.0348	0.0441	5,041,064	430,222	12,837	234,013	31,681,941	4,610,842	28,322,860
0.0400	21.9%	85.4%	2,928,859	23,712,018	139,071,149	35,287	1,761	0.0448	0.0499	4,507,434	340,076	10,920	190,512	26,640,877	4,167,358	23,712,018
0.0500	19.4%	88.0%	2,588,782	19,544,660	143,238,506	27,933	1,483	0.0548	0.0531	3,108,240	286,628	9,159	155,225	22,133,443	2,821,612	19,544,660
0.0600	17.2%	89.7%	2,302,154	16,723,048	146,060,118	22,670	1,196	0.0649	0.0528	2,673,568	330,427	7,676	127,292	19,025,203	2,343,141	16,723,048
0.0700	14.8%	91.2%	1,971,728	14,379,907	148,403,260	18,444	1,074	0.0749	0.0582	2,034,613	185,567	6,480	104,622	16,351,635	1,849,046	14,379,907
0.0800	13.4%	92.3%	1,786,160	12,530,861	150,252,306	15,237	888	0.0848	0.0583	1,721,538	154,459	5,406	86,178	14,317,022	1,567,079	12,530,861
0.0900	12.2%	93.3%	1,631,701	10,963,783	151,819,384	12,200	696	0.0949	0.0570	1,518,011	131,806	4,518	70,941	12,595,484	1,386,205	10,963,783
0.1000	11.2%	94.1%	1,499,894	9,577,578	153,205,589	9,626	621	0.1048	0.0645	1,556,043	297,484	3,822	58,741	11,077,472	1,258,559	9,577,578
0.1100	9.0%	94.9%	1,202,410	8,319,019	154,464,148	7,649	462	0.1148	0.0604	1,067,805	95,750	3,201	49,115	9,521,429	972,055	8,319,019
0.1200	8.3%	95.5%	1,106,660	7,346,964	155,436,203	6,046	379	0.1248	0.0627	897,630	130,020	2,739	41,466	8,453,624	767,610	7,346,964
0.1300	7.3%	96.0%	976,640	6,579,353	156,203,813	5,021	352	0.1347	0.0701	1,251,240	344,826	2,360	35,420	7,555,994	906,415	6,579,353
0.1400	4.7%	96.5%	631,815	5,672,939	157,110,228	4,072	301	0.1448	0.0739	630,464	82,490	2,008	30,399	6,304,754	547,974	5,672,939
0.1500	4.1%	96.9%	549,325	5,124,965	157,658,202	3,270	199	0.1548	0.0609	535,241	67,342	1,707	26,327	5,674,290	467,898	5,124,965
0.1600	3.6%	97.1%	481,983	4,657,067	158,126,100	2,781	193	0.1649	0.0694	527,615	67,728	1,508	23,057	5,139,050	459,888	4,657,067
0.1700	3.1%	97.4%	414,255	4,197,179	158,585,988	2,600	182	0.1750	0.0700	401,568	58,855	1,315	20,276	4,611,434	342,713	4,197,179
0.1800	2.7%	97.6%	355,400	3,854,466	158,928,701	2,149	131	0.1848	0.0610	348,205	46,195	1,133	17,676	4,209,867	302,010	3,854,466
0.1900	2.3%	97.8%	309,205	3,552,457	159,230,710	1,865	119	0.1948	0.0638	349,872	35,861	1,002	15,527	3,861,662	314,011	3,552,457
0.2000	2.0%	98.0%	273,344	3,238,445	159,544,721	1,674	107	0.2048	0.0639	229,943	34,667	883	13,662	3,511,790	195,276	3,238,445
0.2100	1.8%	98.1%	238,677	3,043,170	159,739,997	1,523	112	0.2150	0.0735	354,507	50,142	776	11,988	3,281,847	304,365	3,043,170
0.2200	1.4%	98.3%	188,536	2,738,805	160,044,362	1,337	73	0.2247	0.0546	268,823	15,217	664	10,465	2,927,340	253,606	2,738,805
0.2300	1.3%	98.5%	173,318	2,485,199	160,297,968	1,167	100	0.2350	0.0857	184,353	29,313	591	9,128	2,658,517	155,040	2,485,199
0.2400	1.1%	98.6%	144,005	2,330,159	160,453,008	1,139	80	0.2450	0.0702	201,718	22,739	491	7,961	2,474,164	178,979	2,330,159
0.2500	0.9%	98.7%	121,266	2,151,180	160,631,987	967	48	0.2547	0.0496	155,455	17,181	411	6,822	2,272,446	138,274	2,151,180
0.2600	0.8%	98.8%	104,085	2,012,906	160,770,261	872	55	0.2650	0.0631	167,248	13,940	363	5,855	2,116,990	153,308	2,012,906
0.2700	0.7%	98.9%	90,144	1,859,598	160,923,569	765	39	0.2750	0.0510	92,044	11,326	308	4,983	1,949,742	80,718	1,859,598
0.2800	0.6%	98.9%	78,818	1,778,879	161,004,288	670	40	0.2850	0.0597	129,701	13,749	269	4,218	1,857,698	115,951	1,778,879
0.2900	0.5%	99.0%	65,069	1,662,928	161,120,239	538	23	0.2950	0.0428	177,093	4,781	229	3,548	1,727,997	172,312	1,662,928
0.3000	0.5%	99.1%	60,288	1,490,616	161,292,551	490	19	0.3050	0.0388	127,677	5,376	206	3,010	1,550,904	122,301	1,490,616
0.3100	0.4%	99.2%	54,912	1,368,315	161,414,852	432	15	0.3144	0.0347	158,490	4,172	187	2,520	1,423,227	154,318	1,368,315
0.3200	0.4%	99.3%	50,740	1,213,996	161,569,171	370	18	0.3250	0.0486	137,408	5,185	172	2,088	1,264,736	132,223	1,213,996
0.3300	0.3%	99.3%	45,555	1,081,773	161,701,394	336	21	0.3345	0.0625	158,624	5,642	154	1,718	1,127,329	152,983	1,081,773
0.3400	0.3%	99.4%	39,914	928,790	161,854,376	295	48	0.3456	0.1627	165,667	9,621	133	1,382	968,704	156,046	928,790
0.3500	0.2%	99.5%	30,292	772,745	162,010,422	198	9.0000	0.3547	0.0455	140,780	749	85	1,087	803,037	140,031	772,745
0.3600	0.2%	99.6%	29,543	632,714	162,150,453	163	22	0.3650	0.1350	137,173	4,610	76	889	662,258	132,563	632,714
0.3700	0.2%	99.7%	24,934	500,151	162,283,016	137	12	0.3749	0.0876	157,864	7,660	54	726	525,084	150,204	500,151
0.3800	0.1%	99.8%	17,274	349,947	162,433,220	95	6.0000	0.3849	0.0632	72,201	382	42	589	367,220	71,819	349,947
0.3900	0.1%	99.8%	16,892	278,128	162,505,039	68	14	0.3946	0.2059	76,629	1,440	36	494	295,020	75,189	278,128
0.4000	0.1%	99.9%	15,452	202,939	162,580,228	47	0.0000	0.4051	0.0000	16,497	0.0000	22	426	218,391	16,497	202,939
0.4100	0.1%	99.9%	15,452	186,442	162,596,725	50	7.0000	0.4152	0.1400	71,658	2,345	22	379	201,894	69,313	186,442
0.4200	0.1%	99.9%	13,107	117,129	162,666,038	41	2.0000	0.4243	0.0488	32,919	710	15	329	130,236	32,209	117,129
0.4300	0.1%	99.9%	12,397	84,920	162,698,247	36	5.0000	0.4352	0.1389	34,652	7,589	13	288	97,317	27,063	84,920
0.4400	0.0%	100.0%	4,808	57,857	162,725,310	31	4.0000	0.4456	0.1290	5,231	830	8.0000	252	62,665	4,401	57,857
0.4500	0.0%	100.0%	3,978	53,456	162,729,711	22	3.0000	0.4551	0.1364	3,853	787	4.0000	221	57,434	3,066	53,456
0.4600	0.0%	100.0%	3,191	50,390	162,732,777	33	0.0000	0.4660	0.0000	9,483	0.0000	1.0000	199	53,581	9,483	50,390
0.4700	0.0%	100.0%	3,191	40,908	162,742,259	24	0.0000	0.4736	0.0000	6,121	0.0000	1.0000	166	44,098	6,121	40,908
0.4800	0.0%	100.0%	3,191	34,786	162,748,381	16	0.0000	0.4856	0.0000	3,828	0.0000	1.0000	142	37,977	3,828	34,786
0.4900	0.0%	100.0%	3,191	30,959	162,752,208	12	0.0000	0.4932	0.0000	4,652	0.0000	1.0000	126	34,150	4,652	30,959
0.5000	0.0%	100.0%	3,191	26,307	162,756,860	14	1.0000	0.5058	0.0714	4,742	3,191	1.0000	114	29,498	1,551	26,307
0.5100	0.0%	100.0%	0.0000	24,756	162,758,411	9	0.0000	0.5123	0.0000	2,885	0.0000	0.0000	100	24,756	2,885	24,756
0.5200	0.0%	100.0%	0.0000	21,871	162,761,296	7	0.0000	0.5278	0.0000	953	0.0000	0.0000	91	21,871	953	21,871
0.5300	0.0%	100.0%	0.0000	20,918	162,762,249	19	0.0000	0.5320	0.0000	2,590	0.0000	0.0000	84	20,918	2,590	20,918
0.5400	0.0%	100.0%	0.0000	18,328	162,764,839	7	0.0000	0.5422	0.0000	490	0.0000	0.0000	65	18,328	490	18,328
0.5500	0.0%	100.0%	0.0000	17,838	162,765,329	41	0.0000	0.5553	0.0000	2,390	0.0000	0.0000	58	17,838	2,390	17,838
0.5600	0.0%	100.0%	0.0000	15,448	162,767,719	6	0.0000	0.5669	0.0000	1,768	0.0000	0.0000	17	15,448	1,768	15,448
0.5700	0.0%	100.0%	0.0000	13,680	162,769,487	2	0.0000	0.5736	0.0000	200	0.0000	0.0000	11	13,680	200	13,680
0.5800	0.0%	100.0%	0.0000	13,480	162,769,687	1	0.0000	0.5812	0.0000	3,407	0.0000	0.0000	9	13,480	3,407	13,480
0.5900	0.0%	100.0%	0.0000	10,073	162,773,094	5	0.0000	0.5948	0.0000	7,803	0.0000	0.0000	8	10,073	7,803	10,073
0.6000	0.0%	100.0%	0.0000	2,270	162,780,897	1	0.0000	0.6047	0.0000	1,110	0.0000	0.0000	3	2,270	1,110	2,270
0.6200	0.0%	100.0%	0.0000	1,160	162,782,007	1	0.0000	0.6282	0.0000	1,110	0.0000	0.0000	2	1,160	1,110	1,160
0.6500	0.0%	100.0%	0.0000	50	162,783,117	1	0.0000	0.6539	0.0000	50	0.0000	0.0000	1	50	50	50

User-ever CB

bin_start	pct_cb_amt_flagged	pct_noncb_amt_spared	cum_cb_user_amt	noncb_amt	spared_non_cb_amount	tot_txns	total_cb_users_txns	avg_pred	user_cb_perc	tot_txns_amt	tot_cb_user_amt	cum_cb_user_txns	cum_txns_ge	cum_txns_amt_ge	tot_noncb_amt	cum_noncb_amt
-0.0100	100.0%	0.0%	13,354,270	162,783,167	0.0000	1	0.0000	-0.0178	0.0000	4,423	0.0000	71,849	1,355,474	176,137,437	4,423	162,783,167
0.0000	100.0%	0.0%	13,354,270	162,778,744	4,423	799,748	43,895	0.0049	0.0549	106,271,962	7,237,811	71,849	1,355,473	176,133,014	99,034,152	162,778,744
0.0100	45.8%	60.8%	6,116,459	63,744,592	99,038,575	245,592	11,462	0.0138	0.0467	28,481,683	2,000,916	27,954	555,725	69,861,051	26,480,768	63,744,592
0.0200	30.8%	77.1%	4,115,543	37,263,825	125,519,342	76,120	3,655	0.0243	0.0480	9,697,427	756,463	16,492	310,133	41,379,368	8,940,964	37,263,825
0.0300	25.2%	82.6%	3,359,080	28,322,860	134,460,307	43,501	1,917	0.0348	0.0441	5,041,064	430,222	12,837	234,013	31,681,941	4,610,842	28,322,860
0.0400	21.9%	85.4%	2,928,859	23,712,018	139,071,149	35,287	1,761	0.0448	0.0499	4,507,434	340,076	10,920	190,512	26,640,877	4,167,358	23,712,018
0.0500	19.4%	88.0%	2,588,782	19,544,660	143,238,506	27,933	1,483	0.0548	0.0531	3,108,240	286,628	9,159	155,225	22,133,443	2,821,612	19,544,660
0.0600	17.2%	89.7%	2,302,154	16,723,048	146,060,118	22,670	1,196	0.0649	0.0528	2,673,568	330,427	7,676	127,292	19,025,203	2,343,141	16,723,048
0.0700	14.8%	91.2%	1,971,728	14,379,907	148,403,260	18,444	1,074	0.0749	0.0582	2,034,613	185,567	6,480	104,622	16,351,635	1,849,046	14,379,907
0.0800	13.4%	92.3%	1,786,160	12,530,861	150,252,306	15,237	888	0.0848	0.0583	1,721,538	154,459	5,406	86,178	14,317,022	1,567,079	12,530,861
0.0900	12.2%	93.3%	1,631,701	10,963,783	151,819,384	12,200	696	0.0949	0.0570	1,518,011	131,806	4,518	70,941	12,595,484	1,386,205	10,963,783
0.1000	11.2%	94.1%	1,499,894	9,577,578	153,205,589	9,626	621	0.1048	0.0645	1,556,043	297,484	3,822	58,741	11,077,472	1,258,559	9,577,578
0.1100	9.0%	94.9%	1,202,410	8,319,019	154,464,148	7,649	462	0.1148	0.0604	1,067,805	95,750	3,201	49,115	9,521,429	972,055	8,319,019
0.1200	8.3%	95.5%	1,106,660	7,346,964	155,436,203	6,046	379	0.1248	0.0627	897,630	130,020	2,739	41,466	8,453,624	767,610	7,346,964
0.1300	7.3%	96.0%	976,640	6,579,353	156,203,813	5,021	352	0.1347	0.0701	1,251,240	344,826	2,360	35,420	7,555,994	906,415	6,579,353
0.1400	4.7%	96.5%	631,815	5,672,939	157,110,228	4,072	301	0.1448	0.0739	630,464	82,490	2,008	30,399	6,304,754	547,974	5,672,939
0.1500	4.1%	96.9%	549,325	5,124,965	157,658,202	3,270	199	0.1548	0.0609	535,241	67,342	1,707	26,327	5,674,290	467,898	5,124,965
0.1600	3.6%	97.1%	481,983	4,657,067	158,126,100	2,781	193	0.1649	0.0694	527,615	67,728	1,508	23,057	5,139,050	459,888	4,657,067
0.1700	3.1%	97.4%	414,255	4,197,179	158,585,988	2,600	182	0.1750	0.0700	401,568	58,855	1,315	20,276	4,611,434	342,713	4,197,179
0.1800	2.7%	97.6%	355,400	3,854,466	158,928,701	2,149	131	0.1848	0.0610	348,205	46,195	1,133	17,676	4,209,867	302,010	3,854,466
0.1900	2.3%	97.8%	309,205	3,552,457	159,230,710	1,865	119	0.1948	0.0638	349,872	35,861	1,002	15,527	3,861,662	314,011	3,552,457
0.2000	2.0%	98.0%	273,344	3,238,445	159,544,721	1,674	107	0.2048	0.0639	229,943	34,667	883	13,662	3,511,790	195,276	3,238,445
0.2100	1.8%	98.1%	238,677	3,043,170	159,739,997	1,523	112	0.2150	0.0735	354,507	50,142	776	11,988	3,281,847	304,365	3,043,170
0.2200	1.4%	98.3%	188,536	2,738,805	160,044,362	1,337	73	0.2247	0.0546	268,823	15,217	664	10,465	2,927,340	253,606	2,738,805
0.2300	1.3%	98.5%	173,318	2,485,199	160,297,968	1,167	100	0.2350	0.0857	184,353	29,313	591	9,128	2,658,517	155,040	2,485,199
0.2400	1.1%	98.6%	144,005	2,330,159	160,453,008	1,139	80	0.2450	0.0702	201,718	22,739	491	7,961	2,474,164	178,979	2,330,159
0.2500	0.9%	98.7%	121,266	2,151,180	160,631,987	967	48	0.2547	0.0496	155,455	17,181	411	6,822	2,272,446	138,274	2,151,180
0.2600	0.8%	98.8%	104,085	2,012,906	160,770,261	872	55	0.2650	0.0631	167,248	13,940	363	5,855	2,116,990	153,308	2,012,906
0.2700	0.7%	98.9%	90,144	1,859,598	160,923,569	765	39	0.2750	0.0510	92,044	11,326	308	4,983	1,949,742	80,718	1,859,598
0.2800	0.6%	98.9%	78,818	1,778,879	161,004,288	670	40	0.2850	0.0597	129,701	13,749	269	4,218	1,857,698	115,951	1,778,879
0.2900	0.5%	99.0%	65,069	1,662,928	161,120,239	538	23	0.2950	0.0428	177,093	4,781	229	3,548	1,727,997	172,312	1,662,928
0.3000	0.5%	99.1%	60,288	1,490,616	161,292,551	490	19	0.3050	0.0388	127,677	5,376	206	3,010	1,550,904	122,301	1,490,616
0.3100	0.4%	99.2%	54,912	1,368,315	161,414,852	432	15	0.3144	0.0347	158,490	4,172	187	2,520	1,423,227	154,318	1,368,315
0.3200	0.4%	99.3%	50,740	1,213,996	161,569,171	370	18	0.3250	0.0486	137,408	5,185	172	2,088	1,264,736	132,223	1,213,996
0.3300	0.3%	99.3%	45,555	1,081,773	161,701,394	336	21	0.3345	0.0625	158,624	5,642	154	1,718	1,127,329	152,983	1,081,773
0.3400	0.3%	99.4%	39,914	928,790	161,854,376	295	48	0.3456	0.1627	165,667	9,621	133	1,382	968,704	156,046	928,790
0.3500	0.2%	99.5%	30,292	772,745	162,010,422	198	9.0000	0.3547	0.0455	140,780	749	85	1,087	803,037	140,031	772,745
0.3600	0.2%	99.6%	29,543	632,714	162,150,453	163	22	0.3650	0.1350	137,173	4,610	76	889	662,258	132,563	632,714
0.3700	0.2%	99.7%	24,934	500,151	162,283,016	137	12	0.3749	0.0876	157,864	7,660	54	726	525,084	150,204	500,151
0.3800	0.1%	99.8%	17,274	349,947	162,433,220	95	6.0000	0.3849	0.0632	72,201	382	42	589	367,220	71,819	349,947
0.3900	0.1%	99.8%	16,892	278,128	162,505,039	68	14	0.3946	0.2059	76,629	1,440	36	494	295,020	75,189	278,128
0.4000	0.1%	99.9%	15,452	202,939	162,580,228	47	0.0000	0.4051	0.0000	16,497	0.0000	22	426	218,391	16,497	202,939
0.4100	0.1%	99.9%	15,452	186,442	162,596,725	50	7.0000	0.4152	0.1400	71,658	2,345	22	379	201,894	69,313	186,442
0.4200	0.1%	99.9%	13,107	117,129	162,666,038	41	2.0000	0.4243	0.0488	32,919	710	15	329	130,236	32,209	117,129
0.4300	0.1%	99.9%	12,397	84,920	162,698,247	36	5.0000	0.4352	0.1389	34,652	7,589	13	288	97,317	27,063	84,920
0.4400	0.0%	100.0%	4,808	57,857	162,725,310	31	4.0000	0.4456	0.1290	5,231	830	8.0000	252	62,665	4,401	57,857
0.4500	0.0%	100.0%	3,978	53,456	162,729,711	22	3.0000	0.4551	0.1364	3,853	787	4.0000	221	57,434	3,066	53,456
0.4600	0.0%	100.0%	3,191	50,390	162,732,777	33	0.0000	0.4660	0.0000	9,483	0.0000	1.0000	199	53,581	9,483	50,390
0.4700	0.0%	100.0%	3,191	40,908	162,742,259	24	0.0000	0.4736	0.0000	6,121	0.0000	1.0000	166	44,098	6,121	40,908
0.4800	0.0%	100.0%	3,191	34,786	162,748,381	16	0.0000	0.4856	0.0000	3,828	0.0000	1.0000	142	37,977	3,828	34,786
0.4900	0.0%	100.0%	3,191	30,959	162,752,208	12	0.0000	0.4932	0.0000	4,652	0.0000	1.0000	126	34,150	4,652	30,959
0.5000	0.0%	100.0%	3,191	26,307	162,756,860	14	1.0000	0.5058	0.0714	4,742	3,191	1.0000	114	29,498	1,551	26,307
0.5100	0.0%	100.0%	0.0000	24,756	162,758,411	9	0.0000	0.5123	0.0000	2,885	0.0000	0.0000	100	24,756	2,885	24,756
0.5200	0.0%	100.0%	0.0000	21,871	162,761,296	7	0.0000	0.5278	0.0000	953	0.0000	0.0000	91	21,871	953	21,871
0.5300	0.0%	100.0%	0.0000	20,918	162,762,249	19	0.0000	0.5320	0.0000	2,590	0.0000	0.0000	84	20,918	2,590	20,918
0.5400	0.0%	100.0%	0.0000	18,328	162,764,839	7	0.0000	0.5422	0.0000	490	0.0000	0.0000	65	18,328	490	18,328
0.5500	0.0%	100.0%	0.0000	17,838	162,765,329	41	0.0000	0.5553	0.0000	2,390	0.0000	0.0000	58	17,838	2,390	17,838
0.5600	0.0%	100.0%	0.0000	15,448	162,767,719	6	0.0000	0.5669	0.0000	1,768	0.0000	0.0000	17	15,448	1,768	15,448
0.5700	0.0%	100.0%	0.0000	13,680	162,769,487	2	0.0000	0.5736	0.0000	200	0.0000	0.0000	11	13,680	200	13,680
0.5800	0.0%	100.0%	0.0000	13,480	162,769,687	1	0.0000	0.5812	0.0000	3,407	0.0000	0.0000	9	13,480	3,407	13,480
0.5900	0.0%	100.0%	0.0000	10,073	162,773,094	5	0.0000	0.5948	0.0000	7,803	0.0000	0.0000	8	10,073	7,803	10,073
0.6000	0.0%	100.0%	0.0000	2,270	162,780,897	1	0.0000	0.6047	0.0000	1,110	0.0000	0.0000	3	2,270	1,110	2,270
0.6200	0.0%	100.0%	0.0000	1,160	162,782,007	1	0.0000	0.6282	0.0000	1,110	0.0000	0.0000	2	1,160	1,110	1,160
0.6500	0.0%	100.0%	0.0000	50	162,783,117	1	0.0000	0.6539	0.0000	50	0.0000	0.0000	1	50	50	50

Threshold sweep (per user, max_score)

Flag a user if that user’s max txn score ≥ threshold. cum_cb_user_amt is the ticket sum of flagged CB users.

threshold	pct_cb_amt_flagged	pct_noncb_amt_spared	cum_cb_user_amt	noncb_amt	spared_non_cb_amount	users_flagged	flag_rate	cb_captured	cb_recall	precision_cb	noncb_flagged	noncb_flag_rate	flagged_amt	cb_user_amt_recall
0.0500	42.9%	74.3%	5,732,616	41,778,098	121,005,069	29,929	16.3%	1,416	21.4%	4.7%	28,513	16.1%	47,510,714	42.9%
0.1000	28.4%	86.3%	3,790,989	22,318,481	140,464,686	12,828	7.0%	712	10.7%	5.6%	12,116	6.8%	26,109,470	28.4%
0.1500	17.5%	91.0%	2,341,528	14,704,385	148,078,782	6,403	3.5%	389	5.9%	6.1%	6,014	3.4%	17,045,913	17.5%
0.2000	10.0%	93.3%	1,331,611	10,980,797	151,802,370	3,635	2.0%	222	3.3%	6.1%	3,413	1.9%	12,312,407	10.0%
0.3000	2.9%	97.4%	383,338	4,175,630	158,607,536	1,032	0.6%	60	0.9%	5.8%	972	0.5%	4,558,969	2.9%
0.4000	0.4%	99.0%	49,687	1,684,177	161,098,990	160	0.1%	17	0.3%	10.6%	143	0.1%	1,733,865	0.4%
0.5000	0.0%	99.9%	3,191	169,047	162,614,120	25	0.0%	1	0.0%	4.0%	24	0.0%	172,238	0.0%
0.6000	0.0%	100.0%	0.0000	42,586	162,740,581	2	0.0%	0	0.0%	0.0%	2	0.0%	42,586	0.0%
0.7000	0.0%	100.0%	0.0000	0.0000	162,783,167	0	0.0%	0	0.0%	0.0%	0	0.0%	0.0000	0.0%
0.8000	0.0%	100.0%	0.0000	0.0000	162,783,167	0	0.0%	0	0.0%	0.0%	0	0.0%	0.0000	0.0%
0.9000	0.0%	100.0%	0.0000	0.0000	162,783,167	0	0.0%	0	0.0%	0.0%	0	0.0%	0.0000	0.0%

Threshold sweep (txns)

Flag a txn if its score ≥ threshold. Counts are number of txns. Tabs: all scored txns, successful, and successful non-3DS.

All scored txns

threshold	pct_cb_amt_flagged	pct_noncb_amt_spared	cum_cb_user_amt	noncb_amt	spared_non_cb_amount	txns_flagged	flag_rate	cb_user_txns	cb_user_txn_recall	precision_cb	noncb_txns	amt_flagged	cb_user_amt_recall
0.0500	19.4%	88.0%	2,588,782	19,544,660	143,238,506	155,225	11.5%	9,159	12.7%	5.9%	146,066	22,133,443	19.4%
0.1000	11.2%	94.1%	1,499,894	9,577,578	153,205,589	58,741	4.3%	3,822	5.3%	6.5%	54,919	11,077,472	11.2%
0.1500	4.1%	96.9%	549,325	5,124,965	157,658,202	26,327	1.9%	1,707	2.4%	6.5%	24,620	5,674,290	4.1%
0.2000	2.0%	98.0%	273,344	3,238,445	159,544,721	13,662	1.0%	883	1.2%	6.5%	12,779	3,511,790	2.0%
0.3000	0.5%	99.1%	60,288	1,490,616	161,292,551	3,010	0.2%	206	0.3%	6.8%	2,804	1,550,904	0.5%
0.4000	0.1%	99.9%	15,452	202,939	162,580,228	426	0.0%	22	0.0%	5.2%	404	218,391	0.1%
0.5000	0.0%	100.0%	3,191	26,307	162,756,860	114	0.0%	1	0.0%	0.9%	113	29,498	0.0%
0.6000	0.0%	100.0%	0.0000	2,270	162,780,897	3	0.0%	0	0.0%	0.0%	3	2,270	0.0%
0.7000	0.0%	100.0%	0.0000	0.0000	162,783,167	0	0.0%	0	0.0%	0.0%	0	0.0000	0.0%
0.8000	0.0%	100.0%	0.0000	0.0000	162,783,167	0	0.0%	0	0.0%	0.0%	0	0.0000	0.0%
0.9000	0.0%	100.0%	0.0000	0.0000	162,783,167	0	0.0%	0	0.0%	0.0%	0	0.0000	0.0%

Successful txns (status=1)

threshold	pct_cb_amt_flagged	pct_noncb_amt_spared	cum_cb_user_amt	noncb_amt	spared_non_cb_amount	txns_flagged	flag_rate	cb_user_txns	cb_user_txn_recall	precision_cb	noncb_txns	amt_flagged	cb_user_amt_recall
0.0500	4.5%	93.3%	234,645	6,706,843	93,216,033	97,244	9.4%	2,775	6.3%	2.9%	94,469	6,941,488	4.5%
0.1000	1.3%	97.4%	68,516	2,566,052	97,356,823	34,194	3.3%	887	2.0%	2.6%	33,307	2,634,568	1.3%
0.1500	0.6%	98.8%	30,382	1,231,784	98,691,092	14,571	1.4%	282	0.6%	1.9%	14,289	1,262,166	0.6%
0.2000	0.3%	99.3%	17,367	674,897	99,247,979	7,535	0.7%	127	0.3%	1.7%	7,408	692,264	0.3%
0.3000	0.1%	99.8%	5,813	206,358	99,716,517	1,605	0.2%	30	0.1%	1.9%	1,575	212,171	0.1%
0.4000	0.0%	100.0%	1,493	35,512	99,887,363	243	0.0%	4	0.0%	1.6%	239	37,005	0.0%
0.5000	0.0%	100.0%	0.0000	11,147	99,911,729	65	0.0%	0	0.0%	0.0%	65	11,147	0.0%
0.6000	0.0%	100.0%	0.0000	50	99,922,826	1	0.0%	0	0.0%	0.0%	1	50	0.0%
0.7000	0.0%	100.0%	0.0000	0.0000	99,922,876	0	0.0%	0	0.0%	0.0%	0	0.0000	0.0%
0.8000	0.0%	100.0%	0.0000	0.0000	99,922,876	0	0.0%	0	0.0%	0.0%	0	0.0000	0.0%
0.9000	0.0%	100.0%	0.0000	0.0000	99,922,876	0	0.0%	0	0.0%	0.0%	0	0.0000	0.0%

Successful non-3DS txns

threshold	pct_cb_amt_flagged	pct_noncb_amt_spared	cum_cb_user_amt	noncb_amt	spared_non_cb_amount	txns_flagged	flag_rate	cb_user_txns	cb_user_txn_recall	precision_cb	noncb_txns	amt_flagged	cb_user_amt_recall
0.0500	3.9%	93.7%	192,702	6,106,491	90,392,060	95,465	9.3%	2,601	6.1%	2.7%	92,864	6,299,192	3.9%
0.1000	1.1%	97.7%	56,540	2,227,798	94,270,753	33,351	3.2%	825	1.9%	2.5%	32,526	2,284,338	1.1%
0.1500	0.5%	98.9%	25,555	1,034,680	95,463,871	14,112	1.4%	252	0.6%	1.8%	13,860	1,060,235	0.5%
0.2000	0.3%	99.4%	14,746	565,784	95,932,767	7,304	0.7%	111	0.3%	1.5%	7,193	580,530	0.3%
0.3000	0.1%	99.8%	5,240	174,331	96,324,220	1,548	0.2%	26	0.1%	1.7%	1,522	179,571	0.1%
0.4000	0.0%	100.0%	1,030	30,712	96,467,839	230	0.0%	3	0.0%	1.3%	227	31,742	0.0%
0.5000	0.0%	100.0%	0.0000	10,061	96,488,490	64	0.0%	0	0.0%	0.0%	64	10,061	0.0%
0.6000	0.0%	100.0%	0.0000	50	96,498,501	1	0.0%	0	0.0%	0.0%	1	50	0.0%
0.7000	0.0%	100.0%	0.0000	0.0000	96,498,551	0	0.0%	0	0.0%	0.0%	0	0.0000	0.0%
0.8000	0.0%	100.0%	0.0000	0.0000	96,498,551	0	0.0%	0	0.0%	0.0%	0	0.0000	0.0%
0.9000	0.0%	100.0%	0.0000	0.0000	96,498,551	0	0.0%	0	0.0%	0.0%	0	0.0000	0.0%