text_shortening_model_v53

This model is a fine-tuned version of t5-base on the None dataset. It achieves the following results on the evaluation set:

• Loss: 2.1989
• Rouge1: 0.5027
• Rouge2: 0.2828
• Rougel: 0.4438
• Rougelsum: 0.4452
• Bert precision: 0.8749
• Bert recall: 0.875
• Average word count: 8.291
• Max word count: 16
• Min word count: 4
• Average token count: 12.8757
• % shortened texts with length > 12: 7.672

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 0.0001
• train_batch_size: 16
• eval_batch_size: 16
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 150

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum	Bert precision	Bert recall	Average word count	Max word count	Min word count	Average token count	% shortened texts with length > 12
1.7343	1.0	83	1.2874	0.5099	0.2905	0.4503	0.4503	0.8714	0.878	9.1376	17	4	13.7937	13.4921
1.2551	2.0	166	1.1755	0.5197	0.298	0.4583	0.4595	0.8747	0.8816	8.9974	17	4	13.7513	12.6984
1.0452	3.0	249	1.1440	0.5182	0.3011	0.4573	0.4583	0.8759	0.8801	8.8307	18	4	13.3545	14.5503
0.9043	4.0	332	1.1351	0.5321	0.3168	0.4774	0.4785	0.8783	0.8827	8.7619	16	4	13.4286	13.2275
0.7933	5.0	415	1.1381	0.5131	0.2976	0.4577	0.4572	0.8786	0.8771	8.3148	18	4	12.6402	8.9947
0.6859	6.0	498	1.1688	0.5357	0.3133	0.4776	0.4778	0.8812	0.8829	8.4762	18	4	12.9339	10.0529
0.6069	7.0	581	1.2138	0.5228	0.2959	0.4562	0.4568	0.8768	0.88	8.6481	17	3	13.1429	12.1693
0.5475	8.0	664	1.2333	0.5275	0.3051	0.4685	0.469	0.8787	0.8818	8.7143	16	4	13.209	11.6402
0.4898	9.0	747	1.2889	0.5194	0.296	0.4603	0.4603	0.8785	0.8797	8.4947	15	4	12.9312	11.3757
0.4456	10.0	830	1.3068	0.5154	0.2923	0.4634	0.4647	0.8796	0.8788	8.3413	16	4	12.8201	10.8466
0.408	11.0	913	1.3598	0.5118	0.2959	0.4583	0.459	0.8787	0.8763	8.1481	16	4	12.627	9.2593
0.3673	12.0	996	1.3905	0.5193	0.2999	0.4673	0.468	0.8808	0.8782	8.2116	16	3	12.627	8.2011
0.3367	13.0	1079	1.4436	0.516	0.2977	0.4588	0.4595	0.8785	0.879	8.4259	17	4	12.9974	9.7884
0.3113	14.0	1162	1.4654	0.5077	0.2884	0.4506	0.4511	0.8759	0.8776	8.4815	17	3	13.1481	10.3175
0.2844	15.0	1245	1.4895	0.5132	0.2924	0.4538	0.4549	0.8759	0.8786	8.5185	17	3	13.1349	9.5238
0.2684	16.0	1328	1.5345	0.5065	0.2933	0.4533	0.4539	0.8761	0.8767	8.2275	16	3	12.7196	8.7302
0.2396	17.0	1411	1.5892	0.5035	0.2835	0.444	0.4449	0.8757	0.8743	8.082	17	3	12.5503	7.9365
0.223	18.0	1494	1.5954	0.4944	0.2802	0.4407	0.4414	0.8729	0.8739	8.3519	17	4	12.8836	10.582
0.2119	19.0	1577	1.6106	0.5042	0.286	0.4505	0.4515	0.8772	0.8752	8.0212	16	3	12.5265	7.4074
0.2009	20.0	1660	1.6218	0.5002	0.2767	0.444	0.445	0.8755	0.874	8.1667	15	3	12.6746	8.9947
0.1825	21.0	1743	1.6545	0.5	0.2868	0.4443	0.4449	0.8755	0.8749	8.1958	16	3	12.7249	8.9947
0.1693	22.0	1826	1.7102	0.5014	0.2837	0.4453	0.4462	0.8741	0.8737	8.246	16	3	12.8466	10.0529
0.1584	23.0	1909	1.7314	0.4947	0.2773	0.4375	0.4381	0.8728	0.8722	8.1878	15	3	12.7196	7.672
0.1484	24.0	1992	1.7512	0.5004	0.2854	0.4461	0.447	0.8739	0.8744	8.2884	16	3	13.0053	7.9365
0.144	25.0	2075	1.7862	0.5023	0.2847	0.4451	0.4455	0.8758	0.8756	8.2302	16	3	12.8148	8.9947
0.1302	26.0	2158	1.8208	0.5041	0.2901	0.4471	0.4478	0.8739	0.8753	8.4153	17	3	13.0238	10.8466
0.1231	27.0	2241	1.8258	0.5003	0.2835	0.4449	0.4457	0.8739	0.8738	8.2354	16	4	12.8016	7.9365
0.1233	28.0	2324	1.8340	0.5047	0.2867	0.4432	0.4446	0.8743	0.8757	8.4206	17	4	12.9894	9.7884
0.1114	29.0	2407	1.8461	0.4898	0.2731	0.4357	0.4358	0.8722	0.8722	8.2407	16	3	12.8466	7.9365
0.1084	30.0	2490	1.8817	0.4973	0.2805	0.4381	0.4394	0.8741	0.8721	8.1349	16	3	12.5529	6.8783
0.1031	31.0	2573	1.9454	0.489	0.2779	0.4352	0.4365	0.8725	0.8728	8.2989	16	4	12.8466	8.4656
0.1008	32.0	2656	1.9150	0.4936	0.277	0.4415	0.4427	0.8741	0.873	8.2011	16	3	12.7249	8.7302
0.0929	33.0	2739	1.9444	0.4905	0.2723	0.4337	0.4344	0.8722	0.873	8.4233	16	3	12.9074	9.2593
0.0972	34.0	2822	1.9321	0.4877	0.2671	0.4336	0.4345	0.8721	0.872	8.3413	16	4	12.9153	8.9947
0.0941	35.0	2905	1.9430	0.5018	0.2808	0.4467	0.4477	0.8757	0.8742	8.2169	15	4	12.7381	7.1429
0.0856	36.0	2988	1.9623	0.4981	0.282	0.4463	0.4474	0.875	0.8737	8.2989	16	4	12.7672	8.9947
0.0842	37.0	3071	1.9739	0.4992	0.2812	0.442	0.4435	0.8746	0.8741	8.3122	16	4	12.828	8.9947
0.0833	38.0	3154	2.0193	0.5008	0.2805	0.4458	0.4469	0.8749	0.8756	8.373	16	4	12.9153	10.582
0.0783	39.0	3237	2.0161	0.499	0.2829	0.4425	0.4435	0.8753	0.8735	8.1217	16	4	12.7222	7.1429
0.0771	40.0	3320	1.9768	0.498	0.2803	0.4437	0.4449	0.8741	0.8731	8.2963	16	4	12.8095	8.9947
0.0744	41.0	3403	2.0104	0.5002	0.2815	0.4404	0.4411	0.8745	0.875	8.4021	16	4	12.9603	9.5238
0.0708	42.0	3486	2.0090	0.4938	0.2714	0.4347	0.435	0.8722	0.872	8.328	16	4	12.8783	8.9947
0.0686	43.0	3569	2.0328	0.4958	0.2759	0.4386	0.4399	0.8727	0.8732	8.4339	16	4	12.9894	8.7302
0.073	44.0	3652	2.0284	0.4924	0.2706	0.4347	0.4359	0.8724	0.8731	8.4339	16	4	12.9603	7.672
0.0686	45.0	3735	2.0392	0.4952	0.2794	0.4415	0.4431	0.8732	0.8722	8.2619	16	4	12.8598	7.672
0.0659	46.0	3818	2.0563	0.4906	0.2729	0.436	0.4375	0.8729	0.8714	8.1323	15	4	12.6032	6.0847
0.0651	47.0	3901	2.0454	0.4903	0.2707	0.4356	0.4369	0.8725	0.8701	8.1005	16	3	12.6667	5.8201
0.0655	48.0	3984	2.0500	0.4971	0.2784	0.4419	0.4434	0.874	0.8733	8.2434	16	4	12.8228	7.4074
0.0635	49.0	4067	2.0376	0.504	0.2831	0.446	0.4472	0.8733	0.8739	8.3968	16	4	12.9735	8.7302
0.063	50.0	4150	2.0596	0.4878	0.2623	0.426	0.4276	0.8699	0.8726	8.672	16	4	13.2037	11.1111
0.0589	51.0	4233	2.0682	0.4932	0.2734	0.4384	0.4393	0.8738	0.8729	8.2963	16	4	12.7407	7.1429
0.0566	52.0	4316	2.0692	0.5	0.2803	0.4445	0.4463	0.8745	0.8753	8.463	16	3	13.0185	10.8466
0.0558	53.0	4399	2.1003	0.5023	0.279	0.4421	0.443	0.874	0.8757	8.5265	16	3	13.0952	10.8466
0.0545	54.0	4482	2.0992	0.5027	0.2801	0.4428	0.444	0.8745	0.8765	8.5053	16	3	12.9815	10.8466
0.0573	55.0	4565	2.0713	0.4971	0.2786	0.4385	0.4409	0.8735	0.8735	8.3307	16	3	12.8042	9.2593
0.0549	56.0	4648	2.1003	0.4988	0.2782	0.4388	0.4399	0.8727	0.8745	8.4762	16	3	13.0661	10.3175
0.0572	57.0	4731	2.0828	0.5	0.2806	0.4449	0.4456	0.8741	0.8737	8.2407	16	3	12.8413	8.4656
0.0549	58.0	4814	2.0845	0.5049	0.2829	0.442	0.4421	0.8742	0.8752	8.3783	17	3	12.9577	9.7884
0.0542	59.0	4897	2.0775	0.5088	0.2921	0.4506	0.4518	0.8757	0.8774	8.5	16	4	13.1614	10.582
0.0517	60.0	4980	2.1092	0.504	0.2874	0.4467	0.4475	0.8757	0.8753	8.2381	16	3	12.7646	8.9947
0.0531	61.0	5063	2.1049	0.5004	0.2832	0.4444	0.4456	0.8724	0.8743	8.4921	16	4	13.0741	10.8466
0.0516	62.0	5146	2.1202	0.5042	0.2822	0.4475	0.448	0.8755	0.8752	8.2725	16	3	12.8307	8.4656
0.0481	63.0	5229	2.1460	0.5047	0.284	0.4428	0.443	0.8729	0.8754	8.5503	16	4	13.2169	10.0529
0.0456	64.0	5312	2.1436	0.5015	0.2802	0.4419	0.4429	0.8733	0.8743	8.4259	16	4	12.9444	9.7884
0.048	65.0	5395	2.1405	0.5114	0.2882	0.4503	0.4516	0.8754	0.8768	8.4365	16	4	13.0529	10.3175
0.0467	66.0	5478	2.1556	0.5098	0.2866	0.4477	0.4488	0.8757	0.876	8.3386	16	4	12.8704	9.5238
0.0471	67.0	5561	2.1712	0.5155	0.2901	0.4532	0.4546	0.8752	0.8781	8.6032	16	4	13.2302	12.4339
0.0434	68.0	5644	2.1529	0.5104	0.2889	0.4494	0.4502	0.8748	0.876	8.4444	16	4	13.037	10.0529
0.0447	69.0	5727	2.1538	0.5039	0.2819	0.4431	0.4445	0.8742	0.8746	8.3598	16	4	12.8995	10.8466
0.0464	70.0	5810	2.1497	0.5095	0.2868	0.4499	0.4514	0.875	0.8757	8.3624	15	4	13.0053	8.7302
0.0445	71.0	5893	2.1609	0.5082	0.2865	0.4461	0.447	0.8742	0.8771	8.5873	15	4	13.2037	10.8466
0.0443	72.0	5976	2.1532	0.5015	0.2799	0.4448	0.4458	0.8744	0.8749	8.3757	15	3	12.8942	10.0529
0.0433	73.0	6059	2.1533	0.4969	0.2772	0.441	0.4421	0.8739	0.8733	8.2751	15	3	12.7143	10.0529
0.0429	74.0	6142	2.1663	0.501	0.2809	0.4435	0.4448	0.8753	0.8751	8.2619	15	3	12.7778	8.7302
0.0427	75.0	6225	2.1336	0.5069	0.2871	0.4517	0.4528	0.8759	0.876	8.2487	16	3	12.8148	9.2593
0.0446	76.0	6308	2.1338	0.5135	0.2959	0.4575	0.4587	0.8768	0.8774	8.3492	16	4	12.9233	9.2593
0.0438	77.0	6391	2.1349	0.5132	0.2961	0.457	0.4578	0.877	0.8779	8.3545	15	4	12.9233	10.0529
0.0436	78.0	6474	2.1331	0.5106	0.2914	0.4534	0.4544	0.8757	0.8768	8.4286	15	3	12.9762	10.8466
0.0432	79.0	6557	2.1389	0.5086	0.286	0.4523	0.4529	0.8763	0.8762	8.2434	15	3	12.7487	9.5238
0.0414	80.0	6640	2.1596	0.5084	0.2883	0.4506	0.4517	0.8759	0.8765	8.3624	16	3	12.8862	9.2593
0.0393	81.0	6723	2.1762	0.5048	0.2851	0.4495	0.4501	0.8759	0.8764	8.2513	16	3	12.7857	8.4656
0.0407	82.0	6806	2.1854	0.5055	0.2867	0.4477	0.449	0.8758	0.8762	8.3122	16	4	12.8228	8.4656
0.0396	83.0	6889	2.1720	0.4995	0.2774	0.4402	0.4413	0.874	0.8748	8.3862	16	4	12.9656	9.7884
0.0342	84.0	6972	2.2038	0.5046	0.2849	0.4494	0.4506	0.8759	0.8759	8.2513	16	4	12.8069	8.2011
0.0415	85.0	7055	2.1893	0.5077	0.2847	0.4503	0.4517	0.8762	0.8759	8.2513	16	4	12.791	8.7302
0.0388	86.0	7138	2.1811	0.5065	0.2882	0.4503	0.4512	0.8758	0.8764	8.3228	15	4	12.9101	8.9947
0.0411	87.0	7221	2.1794	0.5057	0.2853	0.4526	0.4546	0.8764	0.8753	8.2222	15	4	12.7434	8.2011
0.0358	88.0	7304	2.2025	0.5031	0.283	0.4486	0.4505	0.8753	0.8747	8.2487	15	4	12.8122	7.9365
0.0388	89.0	7387	2.1994	0.5021	0.2818	0.4437	0.4453	0.8745	0.8742	8.3386	16	4	12.873	8.9947
0.0372	90.0	7470	2.2076	0.5055	0.2843	0.4478	0.449	0.8754	0.8754	8.3492	16	4	12.9762	8.9947
0.0352	91.0	7553	2.2038	0.5077	0.2891	0.4504	0.4521	0.8755	0.8767	8.4153	16	4	13.0423	10.8466
0.0369	92.0	7636	2.2122	0.5086	0.2877	0.4507	0.4522	0.8759	0.8757	8.3175	16	4	12.8757	7.9365
0.0379	93.0	7719	2.2121	0.5047	0.2877	0.4501	0.4517	0.8757	0.8763	8.3122	15	4	12.8519	8.4656
0.0367	94.0	7802	2.1979	0.5098	0.2897	0.4524	0.4534	0.8776	0.8767	8.2143	15	4	12.7487	7.672
0.0372	95.0	7885	2.1951	0.5003	0.2825	0.445	0.4467	0.8743	0.8755	8.4074	16	3	12.9894	10.0529
0.0358	96.0	7968	2.2210	0.505	0.2884	0.4496	0.4511	0.8763	0.8759	8.3307	15	3	12.8995	9.5238
0.0375	97.0	8051	2.2113	0.5084	0.2869	0.452	0.4528	0.8761	0.8767	8.3307	16	3	12.9471	9.2593
0.0351	98.0	8134	2.2248	0.5065	0.2866	0.4521	0.4535	0.8765	0.8758	8.2751	15	4	12.8466	9.2593
0.0363	99.0	8217	2.2332	0.5013	0.2784	0.4435	0.4448	0.8747	0.8755	8.3968	16	3	13.0635	10.582
0.0346	100.0	8300	2.2486	0.4991	0.2774	0.4438	0.4454	0.8749	0.8737	8.172	15	3	12.7937	7.672
0.0323	101.0	8383	2.2460	0.5062	0.2857	0.4515	0.4524	0.8758	0.8755	8.3201	16	4	12.836	10.3175
0.0326	102.0	8466	2.2416	0.5046	0.2838	0.4504	0.452	0.8755	0.8753	8.3069	16	4	12.8783	9.5238
0.0339	103.0	8549	2.2407	0.4937	0.2732	0.4389	0.44	0.8737	0.8733	8.3016	16	4	12.9206	9.2593
0.0343	104.0	8632	2.2370	0.5006	0.2801	0.4449	0.4464	0.8752	0.8739	8.209	16	4	12.8122	8.2011
0.0325	105.0	8715	2.2509	0.5031	0.2825	0.446	0.4469	0.8743	0.8738	8.2884	16	4	12.8651	9.2593
0.031	106.0	8798	2.2549	0.5041	0.2815	0.4469	0.4482	0.8751	0.8747	8.2884	16	4	12.8862	9.5238
0.032	107.0	8881	2.2694	0.5041	0.2827	0.4474	0.4482	0.8749	0.8749	8.3122	16	4	12.873	9.2593
0.0335	108.0	8964	2.2563	0.5036	0.2841	0.4486	0.4492	0.8746	0.8756	8.4603	16	4	13.0317	10.582
0.032	109.0	9047	2.2470	0.5053	0.2849	0.4488	0.4491	0.8746	0.8757	8.455	16	4	13.0053	10.582
0.031	110.0	9130	2.2412	0.5023	0.2815	0.4457	0.4467	0.8745	0.8744	8.2989	16	4	12.8175	8.4656
0.034	111.0	9213	2.2642	0.5014	0.2809	0.4434	0.4447	0.8737	0.875	8.4894	16	4	13.0767	10.582
0.0357	112.0	9296	2.2428	0.4985	0.2804	0.443	0.4438	0.8745	0.8739	8.2593	16	4	12.7619	8.4656
0.036	113.0	9379	2.2353	0.5022	0.2829	0.4451	0.4456	0.875	0.8746	8.2804	16	4	12.8016	8.7302
0.0298	114.0	9462	2.2445	0.5025	0.2823	0.444	0.4451	0.8742	0.8749	8.3783	16	4	12.9709	9.5238
0.0329	115.0	9545	2.2486	0.5033	0.2803	0.443	0.4437	0.8747	0.8747	8.3175	16	4	12.881	8.9947
0.0358	116.0	9628	2.2347	0.4977	0.2756	0.4394	0.4401	0.8739	0.874	8.3492	16	4	12.9312	9.2593
0.031	117.0	9711	2.2403	0.5049	0.2848	0.4468	0.4474	0.8753	0.8756	8.2963	16	4	12.9418	8.9947
0.0332	118.0	9794	2.2444	0.5037	0.2842	0.4467	0.447	0.875	0.8753	8.3439	16	3	12.9815	9.2593
0.0319	119.0	9877	2.2415	0.5055	0.2869	0.4479	0.4486	0.8755	0.8759	8.3677	16	3	12.9947	9.7884
0.0313	120.0	9960	2.2469	0.5062	0.286	0.4471	0.4473	0.8762	0.8764	8.4021	16	4	12.9894	9.2593
0.0324	121.0	10043	2.2514	0.508	0.2859	0.4489	0.4498	0.8762	0.8761	8.3757	16	4	12.963	9.5238
0.0311	122.0	10126	2.2604	0.5049	0.2836	0.4462	0.4469	0.8764	0.8761	8.3228	16	4	12.8783	8.7302
0.0299	123.0	10209	2.2702	0.5048	0.2829	0.4419	0.443	0.8756	0.8751	8.2804	16	4	12.8069	8.9947
0.0296	124.0	10292	2.2743	0.5072	0.2851	0.4445	0.4453	0.8758	0.8761	8.336	16	4	12.8968	9.2593
0.029	125.0	10375	2.2657	0.5086	0.2843	0.4461	0.4473	0.8765	0.8763	8.2751	16	4	12.8757	8.9947
0.0302	126.0	10458	2.2688	0.5064	0.2821	0.4445	0.4452	0.8749	0.8763	8.4101	16	4	13.0132	10.3175
0.0291	127.0	10541	2.2663	0.5028	0.2835	0.4441	0.4454	0.8744	0.8758	8.4312	16	4	13.0635	10.0529
0.0341	128.0	10624	2.2517	0.4982	0.2786	0.4392	0.4404	0.873	0.875	8.4762	16	4	13.1111	9.7884
0.0327	129.0	10707	2.2374	0.5031	0.2825	0.4433	0.4441	0.8744	0.8752	8.3783	16	4	12.963	9.2593
0.0315	130.0	10790	2.2319	0.5078	0.2877	0.4493	0.4501	0.876	0.8758	8.2646	16	4	12.8095	8.2011
0.0284	131.0	10873	2.2269	0.502	0.2808	0.4434	0.4439	0.8745	0.8751	8.3545	16	4	12.9392	8.9947
0.0303	132.0	10956	2.2163	0.5025	0.2809	0.445	0.4457	0.8751	0.8751	8.3042	16	4	12.8836	8.4656
0.03	133.0	11039	2.2104	0.5027	0.2821	0.4441	0.4452	0.8743	0.8756	8.4259	16	4	13.0265	9.5238
0.0285	134.0	11122	2.2115	0.507	0.2868	0.448	0.4492	0.8756	0.8767	8.4365	16	4	13.0344	9.5238
0.0306	135.0	11205	2.2107	0.5057	0.284	0.445	0.4459	0.8751	0.8755	8.4074	16	4	12.9683	8.7302
0.0302	136.0	11288	2.2062	0.5064	0.2855	0.4473	0.4484	0.8747	0.8759	8.4259	16	4	13.0317	8.9947
0.0293	137.0	11371	2.2063	0.5031	0.2836	0.4456	0.4468	0.8747	0.8755	8.373	16	4	12.9735	8.9947
0.0284	138.0	11454	2.2110	0.5025	0.2846	0.4456	0.4464	0.8742	0.8755	8.3995	16	4	13.0026	8.9947
0.0288	139.0	11537	2.2091	0.5038	0.2844	0.4463	0.4474	0.8751	0.8756	8.3492	16	4	12.9048	8.9947
0.0259	140.0	11620	2.2081	0.5058	0.2868	0.4472	0.448	0.8755	0.876	8.3757	16	4	12.9365	8.9947
0.0299	141.0	11703	2.2055	0.5086	0.2858	0.4481	0.4491	0.8757	0.8758	8.3439	16	4	12.881	9.2593
0.0292	142.0	11786	2.2054	0.505	0.2834	0.445	0.4465	0.8751	0.875	8.2963	16	4	12.8492	7.9365
0.0281	143.0	11869	2.2051	0.503	0.2819	0.4433	0.4446	0.8747	0.8748	8.3201	16	4	12.8783	8.2011
0.0287	144.0	11952	2.2054	0.5042	0.2832	0.4448	0.4461	0.8749	0.8749	8.3175	16	4	12.8704	7.9365
0.0307	145.0	12035	2.2022	0.5037	0.2835	0.4441	0.4453	0.8748	0.875	8.3254	16	4	12.8968	8.2011
0.028	146.0	12118	2.2004	0.5032	0.2834	0.4436	0.4448	0.8748	0.875	8.3122	16	4	12.8862	8.2011
0.0256	147.0	12201	2.2014	0.503	0.2829	0.4433	0.4445	0.8747	0.8751	8.3254	16	4	12.8915	8.2011
0.0275	148.0	12284	2.2012	0.5036	0.2836	0.4438	0.4453	0.8751	0.875	8.2884	16	4	12.8545	7.672
0.0292	149.0	12367	2.1998	0.5036	0.2835	0.4438	0.4452	0.875	0.875	8.291	16	4	12.8624	7.672
0.0286	150.0	12450	2.1989	0.5027	0.2828	0.4438	0.4452	0.8749	0.875	8.291	16	4	12.8757	7.672

Framework versions

• Transformers 4.33.1
• Pytorch 2.0.1+cu118
• Datasets 2.14.5
• Tokenizers 0.13.3