From eebcf934b97a7b8231c73b781a8b2f7dd1e0140d Mon Sep 17 00:00:00 2001 From: huanxiaoling <3174348550@qq.com> Date: Thu, 27 Oct 2022 16:33:37 +0800 Subject: [PATCH] update the en federated files --- docs/federated/docs/source_en/deploy_vfl.md | 6 +- .../docs/source_en/images/deploy_VFL_en.png | Bin 0 -> 41014 bytes docs/federated/docs/source_en/index.rst | 53 +++++++++++++----- 3 files changed, 44 insertions(+), 15 deletions(-) create mode 100644 docs/federated/docs/source_en/images/deploy_VFL_en.png diff --git a/docs/federated/docs/source_en/deploy_vfl.md b/docs/federated/docs/source_en/deploy_vfl.md index ab8bccc56f..a794f6f679 100644 --- a/docs/federated/docs/source_en/deploy_vfl.md +++ b/docs/federated/docs/source_en/deploy_vfl.md @@ -6,6 +6,8 @@ This document explains how to use and deploy the vertical federated learning fra The MindSpore Vertical Federated Learning (VFL) physical architecture is shown in the figure: +![](./images/deploy_VFL_en.png) + As shown above, there are two participants in the vertical federated interaction: the Leader node and the Follower node, each of which has processes in two roles: `FLDataWorker` and `VFLTrainer`: - FLDataWorker @@ -63,6 +65,6 @@ from mindspore_federated import FLServerJob ## Running the Example -A running sample of FLDataWorker can be found in [Vertical federated learning data access](https://www.mindspore.cn/federated/docs/en/master/data_join.html) . +A running sample of FLDataWorker can be found in [Vertical federated learning data access](https://www.mindspore.cn/federated/docs/en/master/data_join.html). -A running sample of VFLTrainer can be found in [Vertical federated learning model training - Wide&Deep Recommended Application](https://www.mindspore.cn/federated/docs/en/master/split_wnd_application.html) . +A running sample of VFLTrainer can be found in [Vertical federated learning model training - Wide&Deep Recommended Application](https://www.mindspore.cn/federated/docs/en/master/split_wnd_application.html). diff --git a/docs/federated/docs/source_en/images/deploy_VFL_en.png b/docs/federated/docs/source_en/images/deploy_VFL_en.png new file mode 100644 index 0000000000000000000000000000000000000000..428a97c28a2210988dbe878cf0ceefa9067d1c4f GIT binary patch literal 41014 zcmaI71zcOt)-Fs1TAV_0C~k#7afjmWPH-!hq_{(I3dJezPAO6fqy&fJ?h=B#TXDJR z|D5x__r3SKAHT47_MX{m&CGh{S!>p0e^ytO!^R-PKtVylR*;w0L_t9Xqo6$XeEAFo z@Rz!dR!KwF;@H;h=G=oHPAj0QD}GXIDC+jl8o5Uq74Ow z1ZcqpabvJ{+#CB9T?bp)La@ALj!I79baW1K`*3`AXlaTc7A0Q>6J0{-MyDr7a37LR>>KixVZhRoAA!>F#%4q z@d^1=)ltDqA{S7{Nc4E>|LfeQ)>@vFc8 zPx=|p#8FVPUnxjSXnUF*G-C$CWmB>RO}s2vxf=2MW99zGo9(W0t=ZdKk4uxW(-HeykGqDn)(w1V^r}aJ`{nbg91H3XXE#X;8fgLS ze0rAx4A1(0Sh}`g%_-sCE(epif7S~u%JpSZD6^8>IdRmr`hpF=0y1@}Y$6kRNoCMnMy-z)#WlmY~kgmCWvMT6H=tm#MmK)aC;iQ}A z=V7!w^c75Ye7fMsM>;A9O%+aWm$Mx9=IJ03qkO#Ku-D1r1jq~yZS3_0_}@`| z4#*i;x;G}D27|zpIQoyofBUCI@}03fquuIb!9d4;7(2zFCLlvvQQZaM$ra|_14Wnl zFn~2x{nExHIXok?GE&;Lyuj^=>Li<*{q1gW! zM&tm#AR=Xpv;GT#AD!sY873;*jW9Ir<3lngTObWXbptoa9%BJ&6(r;@7(7Hai_JaX zT~&o9ef%^(Sbm(3mMoAKS)O z`wvP<@}TodR@+n3_?S4LVBi6JH zTA%iXAM3I~Tewd}EeBJ?-*Ld{uGDkS-YagGx&M?$w>q5O*KPcQwvJtRxn8Iqk)NuD!}#W;xaBKaZa}RX3%tIQ$w!TO@XM_*A9h1tK_J|C+Z!2UBQXr zOh*#Ch^+hmQ>$e1nn8C-BbgtX$^YagUm*?lrLah%L4pDe?8uAG#M4y^&yzl zF82*^zWvF@J_jw8Su3zFP+jX6${%)P`$7lXv*Iua*JZcLrV_tF><8>tpkk_zDsdlE zqMfUGHG4+aCwvMFc_WXCXT)a4fM8@Njoz;t-{(nU8@wV@}@DDeI$odkcI9oT_-KGfJ%|M7|685q^&DBI&v)4tNzjXxS(WYN(mxLv|4=?K2D zO2U-);y)TZ&CJ2T=X964L7(;JY7#2RP}m-BiEb^;56R?z^b8w*i7>-kz~D+<=yws3 zJYtOQOBc=<{IElADeLP0{j7Jzo@bNXWcqj-Me40`Aej!WdlqINu;&(xbe`B{de4dRJnEVt!8KrB>G$nSpKBo&z(e;~$>{ zl3W#XT$fVHsU_tt)r6pqjnr)~e8hYBSn{m_?EFSNF+`<6dD^OsynFN1aFOH29Ge&q z=@8TH_<=S2{FubmOO?~T3l>L}+a-Zpu1kE*Ek*+MIJV!y#ZE_`jd;}b zAgmaPSN|a-s_|TTqkGBakC^Ss)5;b2;ubZ=ZJLzCUkDXY2^#mRg{>1C)O>VzJ~`fB zr@Ns^I`lmKxO)r=jV$#=LP)UP?GzbgY(zr*D{tR=WAT)w+%N{gZ5gdoltzq8O^m;F+YjcwMLJl z1G<~`l^0i6`=W?$s*;?ss!RR)T-;R=k?2aq-!i_Z|lAd?-0sHdaD@$)i1>)(a&017zSqcKJ3? z5b8GRpF4biyMdjR#6M84y;DnUB1aV}z}~=Na>?w)<-?($T%O`Y4IlMCAzy%0;A6@?33)%{Or;|l)&IuJlo(?_?SEz!v4%6y08`UQL z<8Ux<3uQJA3F@d)oq=)(FN*)^Ez945HR}ga)=~ZL2Prirs38_?1MdC|HK=6fUj&N@ z5>phpv_E9s)&*1(75JBjtdBjZ5Fk#YKO^0`ujPGlkIfqJG66S0=$6)7n5)`s_L@m_;3mM!AImW$%c4m2vb&(Zno-5-EdW8OR%UldPh z=e149fs41A<(O3E)X!Y`21_f6R_ml#3s+)9+RIE#GmH;}expLZH#`sIhMEV{wkDak zUx4n^R7Ud={-aG~6SzA&GqbgCyHJuF#>_-wv#WHMjczz_T?QmXF}+{AKrbq7rWlcZ z%0_LDZ1`A}j>?m%`}8wEEcr(MK$z6fiJdFncQoS{EBk^ii33hRD5(z}iJPolj= z#By!+!goe!#K&{IC)C%4-&aMh#pPBU+w$*EW*(lXNR0&@T78Vb?~)5#@%*T?a&1r2 z`p8|17IZ$4BXeGS?40ep8a$6XJ}gtXn%lv*{H$GWe_Tf)`4|wn3RSt) zi&hj1)Oik(WKvJQjo&{tC9w#TXcKh=v`s1-eiO*FURMc-JzAxNQ1UcV+ zn#a80^+g6)=Uf13`#n;I zD-2g)Q#wf1MmaB5ryOf3Mz-_D&!_AE4E8}I-(QT0UNarObdZ8(4_0l%`S=Z}Z3m|D z=&4j}v>ZKxpCB|jB`RI10-0)BMYlSzn$MoODBZL;$i^Du9*5#=?@c`!EaCXTWXbm3 zW+GlY?c(#70=ALxJ4RtK>IRm8@C^Syf%CXE{TmSc9i?$zzqDVu%E{Nmltamuzc5f$ zn6^6ml5&Q!yuvA0rnS6@evu0c^)FlU7=F>U+gkmpvvrz9brtJg_+cbbOVT&=I#-hJxM-?A2RI-wBpR}(<$qO9hFXg)=(DBJJCjNeBD`#aWe zP31ojSjCHKNng9K80}Cy@t;_+W`-hbnj#<4G!I+|7C%WC96iw8K5kO%|Ex4&Cc>D~ zH-w!;KNCRW8?((0SQJo1WWL&fC%Ei16Tg!UVq1uOsW=?^IWX2Q^i^EX_TG4V9mW}F z2XC(5>Mn-BwED}EN2NLO&q(q8MRX{N?awvv&#nS^1xuRpYif#g7+Bw^C9Ms2cHjYG zJ~icLoNq5nt|a4bJB1QV6*bEaboGwCvdI!mePu5m@wG8PJt|8GilK99NpJd>CJs;= zUBP;#_ta_)pP}d>zQ#>5C8Rt`#{K#5G~KV|*B@9GYx3~BzNQ?!siRtFNpZ=8DrcUQ zJe~~~U5B?D2J!ihxExuMH(#w{H@~D?GxA1s-(Gz&vCD&t{&0EJxYtEjq3mdgia&pf z{WcC;bBht`+rL+e|GD3I^tF6UybDL%1bH^bpDZ8ela0&u$S95zC-)Q93e62M5ifb7 zX2EL*Z4}5d^vm}8{`wj1R(7U{KqAZNfpYFb0Gn5e6i&KCgca^(oXURD&lgRK^}csw zmrWaf-$=YLJ~AYHUBlQAB+mJ;PoTbRUwN?dM1`s}t6)L&^w(zxpDm-K`4&Ma^4sRZ?BAsX^3&55FkUt$wh2G{ zC?v{rbCX;zWV?!V>4E;uf~9Rxa#wg2u|SyyuQB`(UQzR$qpe(Ox~_G}C(k9+RVU?2 zG$h`EwfSR(<~x;_|Rr^xnWmD9D6CcNt#eB$;bie{eu|0%&GBA@(a+it>qV={z5!s@k54 zsNDp9dku0(xgv~}c>i9IO5U!ddb_K6#1<`ip);Yy{y5lYX|aG`eY_uM8CpAa2_nJU z_6v7>>w9~PnHu1IBz)JrAvo`Uw1_$WVrbL{A6SLa$`(6>VF`#_d63SYv^JKi%C`bq z)w9ml{jrp!olbB=K0FW<`r1G6&#Lp{Mf!tP$@G#)*%1x>PyBFB3>~ZXoNX?)Sv}jC zUMNKT>iUDpy`)}!%&+>3A8cMEbfzn@j=p}eSYa+K!#j*Op7+9loJF6!Lok6~7u}%Z zFZZQVhrM0C9YY$S$gc38>w(e9o+{3Nrb``G;3ly8V(^(!BY%^_V?#-0MG4#=c9HYA zX?hbvhKk{vA*|~8z060#6F1pkVGehaS$zPS4kMj~Z9sp961aOc#ntC0&5ome*=Ze&hS- zr*&=v0s_hYc8cQiC0nm@$%NgU;=%3dREnwrN;lDt=WE+pd9r~vC&~V_iX#eY2OrBXZa3tApFq;>zo)b!FR`KM@z<0!qPi~YM=tuTfjs#M7fylSsKz8`)k}f&Z{(AHV>eRcX z`aq)O)mh7qMPHv$PMVa5ZFh$yvCbSH=j$#PgTbyH9%2CN3to)L>4UtUkgXK)4!e<- zpreHiy^$)89FxZo!qdlx4LyzkmlSb7$(W;lXv1U_x;+`oIzF#gpOVUGhh+We0pw6n z`S!Vs)$$qBu(2hMzyIYFFDQU9%(8`bsU8o4*!YP|p*8tlJU<)p@95!Gc+z~_bDN@e zXeuUG$1X0>oGr>)Aq{WwL$*oabk2`!)L1OQd#I(^-)kp3A$$&++5x>Bcp8@cHTW+K z;2i>iD!vzlK8K_R_X(`e5KRU1xh@u;S+#UuoV_*Zpef=H*CBiBlNL;YSN&OCLn&$@u^w2{_=dVTNVHYJ-dybP&&R=Re|OG?6e8s#)%1If$6W1|L8u@XAog{5 zk0Ec+lCq)vuG=U1HP*!2f^2OS$U?(#k;XH=8+U0AjSW*7hR+z0HkIeZ*@DU`GB)dH zS0@3Fv9Dqu{n#IWsuGAiG`9NOr6!TzwyT5{6lJij2NTWQrT3N--q#$VvD(-Rj9*#Z z9V%72sGkU^p;ho@jmMUQ$B#^BC|R%ExlA-(Sw3K!N^7ed<&&!me_@&xMJ4s*&HT0D z$Us#+pfbJIcM~}=`l7W)KW^&;EMYt4x!PM$u>GuPOgNPC(VojUkQu3<(8F=9nRZo# zbTTl6YJWM8@uuW!tDZj*9>VRsWlegWT(gP91S!_KpkE61<0}8HSv+N^;|!~p+D|VZ*)2{D$)i+ zEk!~jOa-KmLEMaQdq>P#UAE0@X*CK1pPh(b004=QtTmozUgWN~EfuK$G3bD0noz0W z(09r7ajUOqlaxL?aNStzDT#kB3n@=#)RyY`&<3P}@JAStH~Y0K%gEH%;Y~FJ4h2DP zQ&PiXtz;Zs4s&&sI$mWzmP3r47oNq*CJa^L-GA6C@ADN&!})W+{#it;z9hy5X88j` zEJa}*R^E5*>!%bph=$WsOVi!Bzfww_Ml(=Si|WIE8e@}PKKAjQK?UQ)SZYA1xC$-~ zA(9m)EAXx)mVds~7d(A2@jYI?vrm?U;&`CHFZc!n(lL{S)|*J~{j)*j{in>JXM#ih zQL}b(cVD-YP3XmoJ?iK-Qv35LJPE$Cpgzf_QM#rQwUO%9mZ|2gmRqtEr`S6BE*qE* zBcweOS%gC0eQYR{3$%Jqrs_VRH0vSp2G0e(k07d+=nG>oZ}O-v`bclg73&{>s7h!; z0*!zN%NaoRiId^`V6*v>D=fh2fiG9_37vIL)ISvQr;edxH$U|RwJH}EZ+5GBfK#VJv zO$*}FU$Us@&~G}32%ZLwR81|QE)gLHpwFEB8s&UwCz(gt7|(NYWLmO}v(z}Z&|J6H zuqF&P`S!s7&=BdKF4(r{R`;4{*Bw&x{k?|rGM`6G0NG1&$~0c~U#*R-|M-<~1wUcVeQ>3@iph*hn zQs2h1y1P^(w++gN_Se7ROhBnepx#pEEK`?BN3q{%ub=W_@I;}fFUfv81Tv{rbmO=x zwM@;CA)mSUp?vqAD#Omq0JX5+x+UvF&(bM*4wguDZ*E@^wYhG!1JPfX21p?yOp_Ct z#&%!JV;tGm?kztZe=Ox{a0tZp`8t!26;W8$xl%{@0@SWtBex!$)@H{XJWO4=d0yUorm=c}Xa`#n^ZjC- zM5%1->L8TOZD^5svo%XT#7R=QeXy*rzZ?7TY2EM;NH#%xJ4aCA zQOW+*sbeLWiQniM$oc-OjcUF9Yg-bCn__RL=z=|GmXN=!Obeth`rN_v#ny-!qiAp8 zul|C*IPL^0)kS*$&bK;?x$q4NFQbZ0C4HXvE~q=twoeEJe*R`b`x+K-&Y7`s@n^uRWK|ZCc5pRTH?>V3d->PIw@Yzl zq}_OZzBRe_kw}8!FFSn`V|{&)h=d*Bsy;QcaU-|CPsSM$3@JxOHwTuI=tF+M?z~&R z6w2LttTN{YNFpMIU5F^(n7*V_Ny4CCXi68hG2THt#T>o+c{$r*Zd(3p`E9*`@+lqL z`f*fXpSQ%w=Z?E6eR~>IRAnZu@B;dh-4HGGkLgVM(dKm9tTar*v&+}u%dpM zmJJ8!v&k&(cuoT8D7)_b9I7l$ndiBq&%Rwj8feNve8so#>HvjE;N#eMKq!*XZmXf&4mlbbCl%fw; z=He_39g#>Qg3$5Yy3fWHIoj~;UKB>G0%SaYx^hZ^mUQo1zW@5&0SL7nh9$}HaZmaB zIGuL(bzXAPyg4noxmbHa%miU~9hiHT{f-!-%KpYTz}@*&jG>2T4<0^yjM88iW_)|G zx?aV^glmS;f2+f$v*hoEhS?|Yczw68XCg=cwq)WvgrntA{=&@aXGuO-0~{B62_SWL zKWzbj_Q(~~r)%+hyq8=uaa@D=|#v z1K2JOWC9^&A3fFUeMfSzDn7YRK~0Hnl4}s#aG~%TNrZplMNXFQaE|mkkms~VUoLrc zIwIGZiCARltYRrRZV1ag+V?j0v91^TVVjfrQt$kg;j&u|YIFMj9YtaYMEvoAj{T&7 z>NszVegqzf)SSPy|!c#&8-uO2*jQZ&|oXhE#c zf9t8aKM`;Twfe%P>-^3@`}5D}^q{h=>oEjhbl)wxhj%?+!{bDdg-7hv3p-|xQX<#C z)v0DAS(b>wcUYGE`b`LyfXAal(uO-wGbF2CcKkqJ5XR zMBH*y)Ubn3vAsM%{GO7#cduIAgKOeD{26??}~j zRJE#fsBNcQ+|=a_L@mGznTOjxADMyJ;gp$Beey?YUNZg$7hk9TbF&x)*x}xA*sIEAA99g zDAc3#0rE<|RK{QtAEMUUwRm)55zq$;qxC2Q2h0ea&T-uL+?lhVtONdw&+~)utm&^bF z&QX6d7HpW^iDTGMR6Rq`?Jv(*a9FgL#5p@Fb6?&i8^rNIhhyp0OBiVg{?g z66Gi(M9d4AlPhMlQzRGhB6OL+XevhBsucLom-{~ zBE)An0peeS8|>WP#Dqt}{+wJSuPYqQrn6~DHnYMAk(v|t&|64nuc7B$4Yf;Nh^)LC z@Q(FICH~?RvI(U(PntC$Dn~E7UF9L)GR(og1M^}g7vJH1MkW*jd3wyWF#;YjeL*IQ z{L7a@jo0a>;yW?G9&$HwPHV_m2Hg&U^aN>h+)}h`!L=|_X`l%^9644GfhS{uNtY{9bH=qD9A+Zmk*54y#%;?d^y?NxutZ8zH=cs zWD3Jo_;omUHZb5pzo_Q#yCv4tba%kOatpm37H#$II6Gt-Y_V*1;XCs8iH!NQ_$f){ zS0`+P8vl9Zhe^KQE@=%%DIRi-u%VhP@Jjwx%4KVAk%#FCm#+BZ`so9~IDo_0Qr5kT z>9N({Kl+hJO?d3v-kt+}<3%G+K{nX>h{zQl>-5y?08>uo`1R8;aDaulknXXP;nnfO zeU2yU4sdnIrBoDyYy^?GUve29H~@?XXXgf7 zw!T4iP0HQ@G0~Zo=m)!e89*03-et1;>!@YV>9>TUU(JxCPk@lL$>-M1V#X<`E;-7z z`W`76!mKN1NBp3T7&jEtIDyGTfMqMDw;RF2MSpuH+6AX|hm*u@5@>*4Xgfxa+c3MN z?(lWe#6W!h4%nui0wW*pvk#NmObqX-@Ljw z)X;zuK@yP~ZvEyiQo#-u$W#Won}eq!uDV;bQwLuXU$7vXk^`(FrVGwS=;nZDu@zr&Sq~5CwNM7`tgzWy;<*>S4Xb&>QX*lOUg#&B zD3}iBUp?E}d4wX1cK){#zZfn=DKJllyT*XGS44R{AJlMl$9X@n7BDZ>A_5L;~n2u z<_VrHy4*HP`Z}XuG#&!H?tT&erSDG`R6cb0E%|y>K^qGa37tE=fD$m_a0S|(EHnS| zlx-2s$mk1tfrfN7Mt-oYFkmYcH_jQqs4RGMYkjNBN?K5PYiH)xEBrpmEg92D4h4B)us1kz!uw_dE+c>)@AW}xC~4qXaYe0 zR6tlLbvh^5dd9sdFE99cTpK#x82|GyN1lj5p-8!%^BL7-0DZXA=AQ<;1VOO4su|)m z94fIH*=zIFu+xqqxC5(`eynMqo4QNT9b4CkVY5)ePW-Rn?`*cR!vRa*7-%g;xP@$U zIMi3#2g`Mye{+G(K5-eduO#q$4^8S<*;W@6nsIxgshZETNYx0iQyT~PhBipoFe|*Z z#+U}|ucQtM4tiB$J4oGpjRg`grz)Lp^&4ziymb69o|cL{TecC^VK*}Db+f)(Bc#YR!Obx zWJmkR*TS)P;s1_5Qvf#Oa$zVR>TWToC(*ZhD6n z4X9*Ngrh*tAXs0fAfwNfkF?+^chZ5VWc`Var-S>ju~EXyzSGa1(N+RvKY`urM0X{a z&$UBsU~YTpSuo8v3tv(@`&a={74y^#S9jL)LEy$_Dy*;Zdw$MSiezs`L0;CPnyNYf=)wS6%~qaxvdwsQ`?hNmT>}NCzUV7Hu3bGv&Ph-{ za5xTgMaP#jMkt)kSw_+Er33wM2l{YyQ~Y@G8||v{z0`M!j$t(NEcXf-@%wE#Y|8fY4y4AU7kqjs)MpD_&0IJG+4&i{W;VbFRiNVVnbd~!VVnP>n%)Q*YGE^^;?>T zSU$WCVw^)?o7n#vL3=~p`(zrcB00nroy-7GT?|0v9Q6o?#dFcd{r zH(i`Z(;Z1V-KwdmEuo;tQCd5`3rG< zWH&q=JPjuf_|||0`Cz~zqn!j4Zlw0^`2W61WQ9gLcT;bw1q=Ga78TDw*k2SXA_!zwH26j%QgF(KH*u`+!+FUr}48a#<0Ggf( z_6bA=t$^+6ZgjXMtU>|VyclGBj4VQC*HHg`B6lnI*q^r=nQ7OoUqGM_88lT$ly&Z! zT~0Yl$sp1@k*fY9W_Y0f!@nCx&gN^y0zz}qPe!^|dSv|USw963UphYgQQ}GNlOO%+m7Ctxr6N`z}dxN|=Ld7JX7pT_VZb=Xu+1w2r!5I1|<|MVX z{ng=IU6rSEJCpo_^PcS8rx8?8)<^*{oRW}m4J5t#r1_j#VH|MB2g~{{U3+Iz6uPvr zZL0zW8mlcc_0+_sKnohgXb4q;JC{15W$C;>v59U?3{kIJ7UqNL!ew9^FXq32?e1;4 z#x02(3BtLu-Z1#g0K|*P1CDR4zK&L0wg!kDP&$TDgsV)yEZL8YZ!{iz7T3ki8bP!c z68}BTs4s5C7HKSZN=F~Q-Ra|`H@Pqx4&Md0|EvS%-Ks(F5PTMDC)4sZNZ0^(vCr&& z$jR$cy8igy>=Oy)JecO{uc&bJ6FW%nlTSXKs{oITxOEe3CJwr6ZUY=?tV=r2BQrl$ z%c2tvpOpWw=rH0Ba7(CzA_Ha*Qx#Rfj$-9-ay(Qm38-2heSBT})%24UOAa#1Kcwg+ z?&3@Id_wpNDJ(HFvNdCFU(tk0Ug<2fh4H|KM{tW6a~Qm%<8@{aE1J2a5o~sYh!yZF zonT&8>RNhm=Mnds4qflPhNX*VDu*F6s*3WA1OB_o;t+~VJ|`vquG6Oy)EYm2kPmU;MP zX!=?49;s?vYLTR?Zy#^o^Cwkt>juM_EpNm>t$y3lT|7jiV{V}D&S@PdZH`nkHB6l$ z<~FF$gHQLMuM0nnZ~6Y_1&)@hGHE?5;%Dbaj_J-PG4=!E0T)IbjKS^ezTH)O^ti)B z=kuaBhUhVCfM@=c6s`W;-CK#gT9I;ln$+=1-;xaO40Y$eLox~==$au0;K_=(`XG4f z2CA?;C7o>>_Grb9k1WyiW{PTXQ&!~I>CO8dzXu9L2V(J~uBPC(wdw@0pq473DOhzU z*)TN4S%|cE9v%cP*J4^69vdxiN%Pp!^50>6CRoEmjL#69$nHaVn+LkPS0k2!0 z$yKt1I?s1hd}(6s2C~0-U~FCAO~FW2LleDE%( zfw1N?ozw1$Vmp?Q>%y~zAYVF5=S=nJfAI8!rmN0TG6_fvE zD^PKI5xIi7`4a+&aCTq?=BPE=a3vJ^f+s=0Tp}m&=na2k8Qb^L4KneMoNN4Ef+z7W zerDn1iru!C=FyVo8(2hcujlqge@-lB(*QTj6|3qH$h_u>7%Ax;WGe!Yl{L_SPK%l{OP3CHE`3COz!Dt2JR%(Bln5n6UKTpY42c87&90(MaN-JBaR9(N+AB4a+TcVBP2 zt4vv5V^=d-(7Asr2F{J`U362O)fP-Bem)Y=o|-%$`(aR{|1nAvM+5pxg(O9?CTV0I zhKPBWQ-AvW>z6`LV2We%Uy235u%#R7zE+HU(DKK#GyVs>xpLffL7Q^h>AJR}Qn(-3 zdhfDVL0`zGiPHCm-QXyFnqsWG)3eLfLXIAyE0tOr(9LS32mPDuK{`zYIMWP|+zmK5 z!{l}iQy|OIWt`Si^%gCgcKD6+4mzu(gQUm(H}W^x<~gQ`b{*0h zk(hwza54W*nXF7FtxUf!I$TQh*uw%D1ey=TM(2G}hBz#h?|zne0%g_Zj(#bl24IUM zIYuOMOqB`^_AV5P8`T>`{rK%h_ z7q?a&;CpAP^I^)?$CrHOL~C+;|4U|4g;_i}Z>skPu9%u2YBbqOqFHNDvJ|&(Pw2p( zSCc!pq;`1~J2sW2K9WU3m!FV@Mq{&-I@@t;JLyj+sL(IS6qr-!dSao8wTuR~Rf!z0 z7|^Poj0H#ijBSciZ3+08$I_aI*8W6Efo$P-ucjtWdDXnC8!+BVYBZJP@C+u{h$oTV zl$RWbd`xrHIWw3_=2OTJfL~gIdtVYdRhmU>_i^A*QSkd``$h^T?IHy!$2t6einU#4 z5t4T#0^if@_tXK4i-3P34Tg>C&2OMvp;-iSWCqP;N;_e(bs>}&k<7Npi0svV^?|m- z(ivDyf;+V{@>6Ghbe&2i6Nv&wdOL;g?=_H)0}K=#WaH`h`bUMmLo~q`+Ik3D=et9c zskMr~zY)hKf<#Ld-u!vqxs6*4T*Ld}6oh<<1zhdvfGi|uTSO+|jn&>^b^h09oA*&A zfX3WPgZSX7Lzu;+4Eh6nEx>Q2cWr536FQA0v(6uUT^*EE^;WkO?h5|gR`=F0!r!LC;~@W9(feo5$4=OH`C3Vx@2p|glctSh zpcY5&r;Wj|AxM}=fR~+rxaB0PAsU49{*#U88c_L>p5wvyE&J74lKTUZOTf68xFuSK z>QW8(KE1Q!)`1BIhy$@zk09UAX{VpA`0lAval-8*$IsD zfMUvk&7_b097%To_nS|mZt~I(^P%7QTfmR=2qei^22g91c;lhQ3K$!n%IYL}*Hfa(HH+-(rr8 z%Q_Q*7&$N~p2=sfqVJ!l?PDYQvAR~D(O%5pxB{7hf*hS8I6jxE;t{Uo6}g`6FN6&H zh9qG{(a$lHI?(wCj#BebheL_h3r3KA3v6uyqmpvG|FnuT4LD=20A5h$NK;cQG0I;U zUL+Sx<>6hG`yhx0h#sD$`nF-_biw|xK8VQty4sj(7GI>TY(lgB^d36-vZ8ZJ*2+QQ3Vu@-RMo51Ppx=K{y+AjZ%*ShA4>gT7_mnpBXHBE`MC zTpYP-E8WLM$FqjrOOX>sktpLewNxQnm)9!oOhR!Y-Hlo5{7!W=*gqTW^*hRh@(aQC zv70*m-BcZTz^dF^E8GFkjPiyMj~39<)-wWgsRTD*QyVG=$1pQvT*t|R_e-iF&m`_r~gGPIk-acHs zz9)Sef~DqU5y|T+-w{cHI9091?7mC?($n+8m6C0v3hV}C2UY>?@Lvw?@fkkhr-S*n z^+>}`;PFyBBmRA^~p2e=B38ubi}!G~DGp>iQ++awF`^WFzx!s)-$m zjyW2qDw6FBneCAz_2ggP75U>v;(zC2|9ipu|0rs=LHJ`kb`abhs6bh?4o{y45J4Q& zcdNnGHoeH*hJTByQA0S-p=qf6w+H_pI(DmBFA9Nl|L~>(a(t<=OM<*nlE3Pvk$dNoMM%2=QzNc5R|tm zpsI-6uQb<^Hk5z8m^Mc3z>`4J;W>Pm5i3jQwh=#$i>TE7KG3(F+=G=E=mDeq!%o5b zEa>QyE+vDTn=l17jovm96*?kjT0qK-<(d166Y>cYL9)`5h-h4oAK;zp9?fFZi3+(9 zv|$=ecM>$MZ}89L-8hMTod4J%2$)5;J5I`Fik?w5xdX20UT)*>G@b!%zdP-V6Xohm zL%G{e=3wK88BFxOGW10uTvF*z+uuD0J|v0+8xT4OuI7mf-Hqe2DUyFc z+SuU=B%J`oBIOk$3FSz1r#`N6hU6ci6CkvS1LXDst0n9JnP};!hyh~)coAr>TrEXZ z`+_ByAvpn?{sn!+EA>&-5#JrZlixX zja1(la7E6n9PTE^`sKm%y)IGx9_V}8jK?7e6H_s#l-Bt3<+qn1#WN#SODFi!{Wu|| zOMY%%_Y)fvB`InFO}-Dv_kqII-%dVE5O_SE?lcZCU0U~eq?r2s_~|*|bEE(bB zkY_)a5mY+YzB43m0}TEajSPUTao~#3HVGKLK2uF7*lxX?{o5Sp8?N3o-ON)Cg z9pG`DJ*Ty?#sB&XQMM>Qf-lJRcAfPSJ;wO(fxvk~X|S{1bS%W}_O;W>DFUL#a?$T} zD)oG4@5<~Fr_t;%;ir?DNz3n&0y-Oln+kY}uc!AZKGoqvY!jJt(<6K!r`K)7i}hjc z2>E9A1`|%u25(aVc*6D*>I6ti9@=g;WbBU`KaLd>o}wmR7`%`;kRmYOz*HL+n>dSk z!XP$FbJ{yUP=zObSn$I$kFdG-|8m~@q&)dwO+ zh&j!~ZO6u_c2Q8CJQ;ZP;aTl&dMvO04tq{Zp|O*dr0K(uXlv{Vs1WE1?h7=!{{1;} zPYVebxgt2ndg;S!^L9V^Y*gELTx+OLp5`uI$NOvj- zh_dOFZjjt;VACxvh`?Fk^FHtMe&;*qJLiwrg=?=h#~gFcdyH}4V=Y=S{kT!)MWv#a zjVDgN)p)Q84awAPbwW}ngT|KI(_gHuzs3+fjUdLNrSG;~v%JP}jem7wWcx}$ICK4v zQf4a2nYJsUIIb^(vbP9JEi(|V`C4(E4I1~8y&KnCegenGW1e`_nO4<5TjT39rOf;x z(-J6#rwk-_q3z%R>ILwiDiAT?2&Lb9t_1pkY>5yM<04QPCB)sI3CY2JQ^^+o`M8{P&sFc5PxkRfTxs{|yWO z_4J!y4c^Ir{|-4<-`U?g;7qvzs^5QJ_!En;n#|N2`DpKx?`}6J`XAl;4tCDVK^#!( z58Kn^seoYlj|)I-0q}^zqdUjVPUc=)jQWpQcNbXdBwtQe3bFO)xPN@^2YVP3WtZiI zkX6-thhw`srP+nYtD~=Y)#~3_#1goFOmsvZc_yJdBb9{PSR(y}y2q{QT@R{2{7}sY z@MSFp_nUiFuLMx_9(gq~!Mug5D&)~@H4IjR$--UM(qkG4=6UIobc2Sv=pE)$qc{Uf zOQ4u{PiL0Tc?JXb5VdPf?jw;hEl4EOji!MGR?(NYbKEkkO^FmFF(dCx(~K3Z)r9P4 zCiH*2lP>uk1{pL1wmlGH@W9k}tT|7_BNYgl4e-l5Whhe--=q;H0SvFOVbchU1_tyQ z+rO2kQrZNV`u}*ORHl{1@x7?23UxU`96LRtbh}db&sWbs0Tj_Zq;9@{m>ICW+Ol=- z%(n2-vKQR)eQsDVyT@WiMnSTC#cCwxlUr-}LNGhddLK^-bok;?YpDItLTImlgab-C zrt(+afl#*>8Uqjo*LA{1jd*ErCodL7o_Cme0r?xNLa;#QLoyv}Y&k)%Z6jv$G4D@nG9b=dOY))(Y_ zkH&9ttW-%%-9_LN9&UvjthjO++Zo3hU~zSE`^*2<91Cbx7ZAM>Ib13?pkSf*<-;wn z4BOf*>%e*OiX+K&fws`*;cdRn^TDK!wS|sN4VQvJWyy#YdQ5R71)kO7qbZ9NTre=( zezoZFk0^-FAzR?(w`H+hDy5^r?4w<;hK~Cn#jUwDc zoKJ*8rB{VcMKXqMhEXC)Q`|*Jg`!bLt<7U0g&hF(X39Y?U`nb~OM3KpF_bT@ke`JH z82#16ewO=-;n2H1T#(IRiJ-fq|Ev-nB}wK){5N%XbfHEL_!&y9o3b^MXeJwzJmfZs z#d`F2mHwuC2>$oHdL`6y1c|3CJ~9meCkOigoC!&O;G+Zg`%~f~kEb}IiJ}r2<*6$s z4hAHiGQO}H&OfX_T*1X!+#AaBXk@Mz*1{KmEv<*tX(89QsZ+;OQ;_pwf;5a zzo2ew>Dna4Svba;pXM)ffqRGKV0Dgij8#bKVT$u#*x%;`w7~p#9c=XGV%^E!S|+G6 z8~=D&G}d19)ZP8#Qn3!*QfSdb>RK}%(?q2HRVx)=`Ii!U?M7}*>TFX$|=q?hhPxE3UgaDbO9S`gCOZjFzJ{lJl*)~v=_ zPH7v{aWXIMX11eSJu=j%zX;LlpENd7aPUfV(AU93TkAerNl!e$saVFa_DzCEuRN}j z%<0;;@6%^7rA+^gJEj^nxgLFxH-1>_a_UZelbc%$W?j1MpA_5TFKYfAycqo;A>nGI zF!O;KEVkGDm2NCPK2d48VD$i%-@txSW-sayMf<7zae^c7QAdl7cvgJ87ms`BT%gji zKneGs_#>5!Vl<9X9FN2wtZf!ZkU?_>E`opHC^wIzZwlv%Q+bQpb6~q|l{7ULMwKS- zS-koj<{M=>LGAGor@ORywM=YRTCNN22)IOKM9ocLCV z012yExZsZk$3^+S1w*B>|9(?q(o^j?d zi#rc&4Wn#HL>x-r%0e=`0Q@dRE&^c?Fw&80)uS>a4MC>&hcn(T23#U84Z~{-t?FVqD-JX8v~=e6H&WX}YjD&4sS%*?+G6^b-(Vm*% zP~~^JqqH6aqtO$~@NE4i-_jG4=}7SEVWBj8V?%Q+IDK)qj-e>;_llBXsw(lW2S1f* zkz|ngz#|^5ecA7<)n>z_E1AJj?t}LEAbi|8u5Jt@NQ%7z>4QLmEcm_?caN!!*ycNc zC@5=`O;t*hXKZ_115U{4#2#9`V&CM6?lw((oXCxfm zswBc?d_7rbaCcQ;Oc0Kgc-Q^(Cvn-`ZU(xd{(=x-`S<||Ycg8J=)NuGHHf42K@RZS zyPJT}59CrLfCqtgmb>f)@Vxn73Cn~-XQ(0d{}~cwfC}zDiL!_V(hYhvE*LoP9_x5v zV8;JUj(`CV6d^eyth)(;r1&#`1_pAD5dPu5zd>;YeYyOvj0&(>1(JD$c<8p&2qTG! zN(%lx$EX=wJPf4x{1QpHeBN?`e)37jJy7XKZ);O7yjhL zQ}-N&oXl&0kN*5uJHa2zej%`C?rB4wDj%FarXqCQH9Pu$=Y#Hg8~(%m|1EQ`)`x62 zkscgA_V<}|7)Wjs?a1whk|qmRkUfI!eE-v9hz{iLzX?q5s{zKpY`dDMO!#YZvtbsxXJi6Qy6Z;YlPz___@?d8^eRU=~uYOF% zqE{}Xq&Kd*dcir*D3k)t&8r$?Vtu}2AaE+G=tB^4vdujt*@K9sKE@^ilxgC(N4q-K z&l)JUS72^>0?9ib&kE8y8jH_@BFG*NO|Hag5DU{nfH;-T=TVJH7ap??2 z<#x6_yy=bz!Rc_$v3>ixtZ3&9xhUx;=QW=>VRFm(D&%5a=|m;(z?bz*nrYU~kscM_ z$M!J|xP>>Ya=3c7PrSlvP+2jU5>@%J=&U*hWXr zKRy9{E_WmmP*`2EcHVD$Rjxk_(Rne5PEr;&K?i>I&K1v1mGw(*AuS2=o*~3m4`lOc zU!aELYs7{MkS4}Ev{?lMy%kJj6|aUg71#REuVyOMpfn?umA*jd#=N3UtmrdXYGPjk z(RnenFVTaQWOG`lRXo>YpPpAf$E^bNi-Vnhh$($D#r0IxGN27g^M0+aT24_8oZYNX ztEr%mszNJov{eXpTyAO@d7q#K6NF^>lEDELzKwV|fr-qWRm3_v547P{7roQSkiz&A zED2He3~5s+FPw+yF}kdUi0^n96hD=Sm0n%w^c{b)<@w-Yu`K=Z+2z{YHaUz5C#lcf zoELi3B;1I?&=P^^Kqk{I-`FbR}M4ti2>X0gI7hti3IM zY%1O_%C{Jsnsj+-A)YlhY~}kC>*gf*U^Vynw-e^nYi`Nf0SIm`0*Y7NvR70q+{$JJ zag#0ceX_ufwSQ?szq4awOkYM(fzsM}Q3+wtP@O4D9~+gXf{Psb9{BS_zIU* z!MkA_%rcYkd3tWkPI90vqmQ_wVFLM!L{hgcw-m9ob@LJKA)v(p&eeYjebJ~rXsLES7!T}TZ!$;iYEgZ4>$L6#acRl5ELjyJ}XxAguTwpX; zee^YPhyv&(9nM`7((f4Y*ipenB|_HdIj*2v@x_VwnDcNHJN(YgSh~xH<4%Gk<2CFr zS;b%f_Ec^vKC!?RI__+BBhybTFWS-h*xlG&p>s}a!6B_c)i>%!Iam zs^sTV^&VKkjPmuOWvqaA5T61@O8L8sNEx09Fs*UD*q#97)iL~&wIhSO1ue#K)XURs zrsyB7wMs%n8t)+dJswXBG$GX_d9K3wu{ocC2e-~cKW!+2p*uPrBg8c6*v=|5Z-li9 z5>7iSdq@LkI8LInxpGx?+RknosAO6AyhbTjGe$#l#{g}w}`@NvycyvFrfMwTDVtT2B1q0&mxcUIbI<|2)j z2f<)S$EH@6FD0;rDyL0eShPGs^ zK1(hMJ%DpSOOQL9S+jfPS5E`MI*2G&9dy|Z;P0Fq#JqKZ;)xJAwC$04$mQBbx*`cX z;g$Hn2kKt76mEvkLX=tH!H>k7shN)4&IKJ>l~nMPr=NKcU@bZkT)iA_pp|m2T&Ejb zelnF3*MUdn?_D8>JH5A{*6pE&j;X8zmd+eJNY&JlPw52`%P|G4!9DiP1=iV0Cb6dU%_6yYcPQLVR>1Guw}y3L zY*d5-B+jIaQ6_;l(Sjj4BMHP{q3P-Ui5O~X-{^AEW|^-^Amj_i9*{gF^633*oNp$> z#x*Ra<8aY^@dT#Nc+Jno^bxNZP7$oJvXlB=cB|M76|83@lm;wMlY8e7QE;{#KSB@V&8TN zYrU(ms#3LsF18b!LJyCFHq+B)5UrqTo&J#Zg71;{%7>U$x^VrsT*E2akN79U~SkuL9i|OjKGGfs9@# zYuG#C(ZQU9P`CNT9|WhMZuDn=-@e#&JeYog!?`m~eya%46S0wov~sm_mdDG)Hdh0w zNNO-+g6lTn!{HnvrY zn{s5NEGJ-wWYFOCI6a?(AB(;x&b>3LKc+=JAF-(rQzvW0`73+qm5bI%`uMbwKJ9w>6LHX#UseyI7T9MkuU!BaRVPUuk-|bMfQvHa09n z5aNZEZ;HRvFi2y$J{>Ps#PU;~4rlC9H$ue0J4Zk95Rb;o=(l0DIj-{!P2G=viZ+U6 z95ioS4Z5PZR#ZVNQSSO3^Yk71j`G~e#tWblfAETbO@1{vBUlLNGU2Dr1Q=}u@m$PH z_ezi?6WFr!;?sv9M)f-dJRE3I zs93C%nOK{C1^h$>qOSxHLnTnQ;$a-2ido})8Y(fM84bR+wz9GU@9!7LH5;C*`n(>a zl6Jj&PQ%t*e{mKT6@^UIVeqP(>LCL`NnGnLA>Z$ftE4QnRw^C0+s5_KdcijcuIg%U z8B&_#(jOygb2x;0H(qBATxS`cZd5T@j{)DVy!rw+Pa{k^oz9G^6`1vQ_V75`?eF5L zc%y)--s*d@yyBB#x`Iz-EGpP^aSC*j)kYylFv7W4TyP1kvsFb3zQl2@^EylA*LSLn zx+^=c&QQ6qT&xS2%Hpvf?IIfd8t(5BuqLwUr5;ACI{fxD^3?&nyZ3FXLPpkWRJCw> zYRUtxACoQ$`YF)y%9lx{Tr^|*SL2MdaP|*$>Q5>;JLiKOS6F18zMaZq_8dA+tdM$e zRx8uF5)JW^XW5r>h{8j&TzmwCLK0_&HpxTk&ji24HOH$NT4yk`HfEBw0)ale&QzZZ zoR7A>!EwIczCdq-l<*WBIz|euuyj4c&PvmZ*!H@|%7(O>M}0A~2l@@a@#C zM)p@#L)fo@HEpg6n^|0J8$Dz})kYrV2;az+yJyB|fgpWV46p(c7C|=tHL|owbEFEv zE8N@^x2tDwB4Q6OZkJE0`=0M!28+)5^HBa1KjR@BN6z*geZ$nC!2`$R$3 zgerLE_{aCVY6WoA)eyTPL)qV*6_TD`>c3j-$_@J*)6!i!fK3Z~8_}|;p!!tb2}Wz`+yiQc@Q?o_G7f#u5uAuNDc@si zcxQ$BjrY;=Lxc26>eyauZ*j!LCy#rpM(JP^Uunda87#;kGNywG7SBtpa1$A=U(tTw z-_*cx&;8dqs#NF%`3}z*n?FAMIJA6-_d%m{xr&HLFl6~-*D}02(}elhIbLet9B4aL znm5fJsA~nYCfcJ?F6Q`tVCteef#>Fh_6bRI*f*#ves=ugH<4oxVTjByMQ*I@Nu6?- z0a344gDuIn>Y{V%zG1nO@da(y1r&7&rvh(Lh8I|sEpxTJF2xdQKz~{e{dEUD4Djkt zmLP4&*_@(s*_*&mAA?F%0Lo~J+yl}lSm8Q{1W*v+p7B5n2FyxPq{3$|1MJG|5ZY(D zQ5BxtLamsHkus@y*BBXE>n(KtX4FtQdg(iwl~ZuT|lY$C2bv(y}CZ-P!H?XwX8%0 zagIG#Q#U?|^gG@z|wQapDpqeW<8nZT>&eSQoE&T2-#Da`jGj znusLp*RzfMtlztMO1?0Hg+gI3m}Xzq^M#YPQb!ivDdyx2^f+yh&@Q?*lg1PuT9vb2^|`aIo)q6jGXdeQ883(|24uDgXRL&C!w| z((7syQsp12r`ER4r_gsLTF}g}a1)(<<8}QDyJBn4M@U+6@FUczX)p@)EYN{}p_Mv; zTR5~Y82X)(lPh}p3?E%~fXe1)z`^RZ*A+VHSa1uD^7nF-;q^siUT#y$?RF-XBlV#z zmVxlYE8=0m!yg7&3BbnLty8Jq?!T0*9#2jE5XU$nRf`BOqthI^jz*OoKBb`&vGbVS zR?m(m0Pp)W=WmuTTtV?%7Kk{Sx&`TaAP66ie`AzEw zUxe_wEwkr3V_!`7O6|1^N$fbb6{bJHzfBcE_DBS;hH;Z?3Q>3u`ecp&z&C%rv6wsm zRpVs|0_j=VIN44gD+yQ;p$f52E_3f})ZbT5{)Me2ZxME)8%9Y#bW%4%=A@IpGS>@# zIVqoh9Gix25%P9{tegZPaFo}sO0AIWco z2*97ki%bpgb58GM@FwhC$JxdXMjEMx_OtAeHm*>vu&ZiRXED4efBVv&Hy_wlOq`er zXy5Sybgn6SflnLWTy%vsZ8am>D8cl{oH8S#)1AmF4jYhCZ3xpITX6Hu(;DAz6kqLW z`q|GV?y)Gcx3uNXDb6>P;qCs^%(UFJI!a^1Zq+g`)EDr0Z}aTNE{J8ruH|dn=>s6d zs&^h3K>rX9;;!e)lOc-ZT|g>*+GeMewRz|g{N79<4@+^Q>M0J3hKz@P?B1a)arO)P zDsb062L~fBdYuqlhXelsg|=0fgEw}x(Nf}P|I!9|eEQdMTuNvJT@IqJQWD(W*00N& zv)Z19{yJ6)1=(`@>zqCeezdJ1VlF`S;OtB2r*&5)`{VbnKaToUik${^o4nHH#(X=7 zpXu;)8WdUi51i66XcaOrO(GHa1T=AVnNE(SL^E+xGU zxk(ZpuEGc3Vl;kdZJh|n*=_^nw<=CLJvQepl5@17<+NqR{>m&X95O%0*~(PP6(4(h ze8Ns@AoHYhf?%qXz1L2b(@55?V4^dd`wc0(1|u+6hZ$b%x^1Vy>|n62??aM7Prdtb zF{PJm6}|<0N0x6}ZNY9$N>1ryS6#XZtm*q9*plqnHzupL4IZBPk^SpLxeX5%($5;5 z0RRfLkG12+=~OZX4=P){sF{()^r4z+PM$>nO5%f*Y(1LpIXwKve1p411#>dm&ye8^ zxT#$}&`db|>0jFA;DH^$Rkmc^~*~*XWPU!^QB_#bZztmt@ z$zm`78edK97D)K}cb&Q_&yWf^_`HMq2g?Sn-nf&2o4UM%G~bi9bgWr^FOF<(#Dp07 zX6E0?g*P&Mk z5cAbI*|{mHcRCOmr|3I!*_y$pw~}*$K}~5Urw`B}a;39d(_Es2;25=S#rpk6KwMB| zTOiGzNOH0x!i%Of0e+5;4he<-{TRSn+s}UW*RN_A467N~`teWc7Y=qla=S|-#G%#| zq04`z*D@&t75b5)SMcna1=euhKd;THsc_su!?_D*9s|P2MJIg=m;^lQ12DoYffy=8 zq%qB;rGvSvvvT|?AsDmE{Ewkfj=pWoP|coc_%s*ymRN?!Gs1pdF|=k5KlcKB0)u9w+EwlId3ROj zPNn+-4`AO9gZ2+pzG?IjuoGCDYapAncoX}uiY!}si=yddJ)WTqPDuA~V$KD_awJsu z3(IW3pu&N7eYUWt^duRiCof1AGkem4n|LHU6PvHjY|n?s(-p(#E169mWrfv9B@r*# zfdx4&MKF|gQ-OSp=ygo8^TEa!(|xO`^)*|JvoYEdaI=9KG8P1f26^f$D2X`?ESKcP zv`T%qf`M6!@m*t4w@3(2T8sE6Z{Rxde4+HXaWtoACfwZ`!JX`Z?8w@CvP5eoJlo_) zYCSZc-Rp-}1d8 zI9g$TgB=tCm0lZ(1qVg;R>1ZfK9Ckpf+C7YEgqV&s&+bww7;g|G~*-*VI~A)$MbhN zd}@~iZxn7|)E>(c(N?#446-J|Q^mJc6n|!@^!n}(bneqkv^hZ$wS5p^k4iN0=nVan zu+~1!fG?FJU)C4Dm6*YEt6Cpc8pUB>pd`-@gR*{8Y1ojVgKh2XPO-yWt0xB4y<;A3 z)fl%$t&89-Y^5UJIg=jP^gezv!w$Z7m_-zZeujr)$dGx>73Yc`s}{|$A1Y~8HYm7v zTLBgf>e2vCQE2bo;Q($k1U?vzQ5ap>RcUI0659d%&$$ejxiRknCL>oN8nC~8nx72S zuioLn`n?~>LV=^e_l|@F@N!c-fJ=zzke*LliuGSb{@X*oc8b)+Y`*IRil~aAEQpzW zD7gp>;z5^ockn_t;O7%tB%Z7b^D!npt<_F;3jjI@1d?183_F1oO$fnPy)ZP0;h0?g z)UL2x+t~E$u%4EV&i$jY&n1z-p!>VosM9x`>VP!H2Uy}&I5-5_x`<*WRu~4%bbjOC zf1V01=x|p$7I<&Joor}Q9?Vc0(=$O134ziTuYVe^7a*6bzg`on|6w$-#$@>ZTZ6T5 zse#Dm;`Z-#bv>_7Cn78Io|Ud5g_f!W;{XnNG7_h3f3hRr-#UMz|6mXmGP=}2EWaD&N&u%>QZr<-AzS4;y&b_t2$-CeN8s%>g3e+k@6CdZmEG=f3^hfTxfCq`8q6@!@moQIEpTe!sTDi+N-x7LtWDS&XDtb^m*%ZSG7%1!70~q zp%oFfA~_aA*XIrzKkr;(wp0kU3)46s@+*$Q2R}y*tPBQ`&%PcOkx@p41kyKoaK2tu ze@AK=R0hXm*%y${H*h&b#W8tWH_-Zg=fN+A?Vk;M*QiA97KKpiA9pe22^%e$Cc<$i zJ8#9wbKz(<4|4Ee#eR5dlicc}Q#kw_LRD3@bR#ZB~29a*p-R8)Wpb3qCL&3LUi)KW0Vgu+7^uffKrsfcNF9QDVxT zk3-0aw-XQF7S?|9eMxO^&>CME^)}6dLqzCIbXlVDRTow4)Qg-@#lD@ zYy5$0tDM}JoEw56?bc3*Nb08g0mD9N9Qd**!5e|S?{!8y+1n(7AIy@AZ?cVsl2i@` zAN;~2*;APD?U!Y!fMMS4cNHk8J|)RZ*sZ`Yx4_+5<-L>7n@er3_NnD?Iu?PZZxTAR zFD3W0Q6L?mOh1h$Bn{g;()mRTeNQ^~)kP0N%4CWq>;2@E7TMYDSR~EgQQ(JBf^&Vt zwRj_5t7rRM(%HRN`~BOq2jgeTd;GYD-3uqOTwcata`5u?vt{^8%EvEM^Q1AfGmReZNo(wso6R86=jx5<0`F7)~Skx7t;r)VEZ& zVCth!A6=b1ZGA~*zpTYA?6-2%q5i|DAe@sKTXnf=b7#HETD@k|m9TCRHQzj7snzAD zzTZF2nT!o@lZSDFMdA34x-a58{YM^jttRlMJeOUC&IfKxC8Oo6R z-1C^?)j9As#pc9M$K`&$p*Q_Y7FRz0xi0lBzgJp=S776-0K(E?L6DW-!}$LPQ~}6H37GJetiuBv+vbwL8sRQO;{OA_a+coYVAgc2f*q=Vtv4Y! zF8TianE>gFjlPyFke zCEharlRgpvINnqMWS><4ZhE5KrI-LZW5k7k3bnj(?*}B7BLRhhy83X)gM4toSKf4K z&cFX1yZnGB3%5L%9IbPEc53L57r(w&Z z+++|e2#uJ#9Ad49`5VorVrL-t2?CT$zC(am;1>@%vRn#v6dlBEx=dwNVlLO@mm zsYEFgT5Z})hVM)ofb>sYAdtd$umqL$OXdKBlF(y+D|-wby?V?4c;Juet-5bddL{oh zlgHe=+HBW}%xY1~`X!g$e|cyfI@`jIN-6z+_c$e%vHK|eMf&fD)egy_Lx#X?oGitq zZ$GLjA_8eS!9QoozQEm7(_EIE^Q%&rf#5FZxJ!&TmO=cg|9D7GWtW43dbVaq1x(NA zrIPx!PPQ9j!FtfE;a zdjl?#R(AQnjL!M39~B+b0UU^b+uiu6Iobr8>jXX9O5KSJ$lMKoRKl|c9vdko$Me!2<`#q|fB zl|#`mHb04@%n$L*#m#+~?KtEQoZ>UBzwF0JI>gsJ(;E+S5^-^@?||E+35`HjLeZ>J zeoXYg6Q*|b3p3AkT^c_b`}Ljd%7P`YmvkW82kNgkxw+(F_35`&)u>ngk||=rL4-CbtdN3hJ~eNVkT2-z((*c70^%lLZTtF3RGA7HS)G!UZ2f*g_eNA0PH zs|>NwYbw1-APeu@w_v~NrwjsHMkj5ryEE6;sKY%zuQfsr?mdOOTilJ{F5%(lvR5l( zYT&nnVGhXX(Opyu+YgTjf0*Hkou>-KZn4A%_eUh*p)o(XRU^lFcVNW%VvH3$MXz zDzD!l;L#__XPVWbDJH)#T0>fKA{*@(IwYp=8?Sh3$q%LgOOp!I=@^O5l#sEcX}2m@ zWO;#i?+sl>;ljH#KaJbg8=)t{^)3GP+dUDHtW3mU`%zY;G-wA6Tp<2p{DXOJ-Xl-( zSzOI__US391$LRvoP?;aN36jhVJ}8c6vDv8z`5X| zVu|>#iS94e>~(1Fw()`lxrO8UOKKmC&WBsRqLgyVs(rJ>6`9UqfQZ*yYx{`VJ0*K$$isd9}V8@;c2%ARu(*j$moVcAox2Y z*3xLT(nIQ-3s#r;d`(#Ly5!HczhR>{N>@XSGBasED`<3=qwN>;>c1Xw6)2o;UdQWA zBs>o$U@0db8%o{6a|6@&BE8J`OnLO7NMDv-=_#iRf@XbpSx}s9x;ah*#>jYas09Fl zrz{In&zomI-}^G^z3E5foq)Yx-)5Oec}}jyrn)LIz?~FV&ZQ#Elq%eP~C z<`1yyiyKKXHb*Mg0U;#5l{97dRGP#sYtW*duBO>N=_A3!l1eAVTGM)daP7moQ5_p7 zLu_#^d`h7QO)m;x*ZcKP-~9#Oz9$z-ZB&L|pMa}0Xz-s4>(X#)jM#Fe@)SYSLBzs@L^xuEpW%d|RT}M6`@9hG7waF)sVW0v91!@!pwjez!j|PnT1V!arb{I(+sj^R z^0STAV)9|q#6J)cHAz!VY0C+QVG<0nEEOjKTkYVN(_U?J@#Qn3HXJ6EDI!toeo&aq zS}kg3kw~9|5qcO7hqyZ(3w5dZS&z6TBHJ=cCMP2~<3F+f3J2U&@)z>m;k_jAt3Wj4 z6bj~l{_39*Ap&jTGJp&bN@w$*vGM9qTYu)C!Abj_2!&ISiO*y9Ovb;%ayl>>Q+VoJ z%(`sx>37E|Mcw7y+lrdak?U}QC-!l9mXpB*^Q!B(#pHp{dH9i7+5QoWw$V)V%-djJH#tUl#L-WpCnQ0?8yDIm> z`8S1n8J_ExOW+A4PZ^h2D^q+RFGG06Ax3puxEO$`{=Hny6w&+SIO|harBN*)q{pNV z`<&BW=P`PF;AEsyQt+-Cn_lHMIvq|piMX8{>G{iiVK5DGVTCx=LTi45ce5N)jH5(e znyF!H79jX;I47N)*}RL{O}P2Q0pKjA|Hf7e5@Jmonk7F_Xu8f8(B>)bpjl1X^su}X z(m?)V;4SWh3UNpD&;S?&UWYGx3Uc5GYfi=-3f@$THB>o(ORw6lbD>aW3mISd{z$5PMY~;DO0ulWJ|9#4N%(Ch5M2Fb_B4=34Ofhs* z9Q=ZPB$2teFIRj4iQ|QT4Bs!;suWl|nl#RhVk>x6TJs`cSte^7Id3A-m|#7Z;Vxm6 zhx2o3uqN(?vPQqOd|3v4bZKDI(MFM*r_Kt8bkg0(~Taak1B;DuDl0Q(}>$f5Y)wfrYNyhwgz7cFk=e78gMo7V@lxt~Zn&WKpJmSwqHB?3Fm|dgi{78~hbW zagSLA^p29^QpeM&o_`~Kfk*cycWsri#W1QN^D60g+T9))LWLlRG3B`0hv{D&I$Ozg zFTChQ!InKu(;b>b2rM+}GJL#BbbK9i>brl7j0^UYby?ujlcrTZxOHf}Lkbs9RJOh4 zKNcT%I+*Pt{1{h2Xi17Do468yn;DtJg{&r&+?N<0@G=M5d5JGLxu zNya+e+B?5DZ5JFVm@BaW6>k{|>&sG?c_Fg+zv`!6IM9aA^)YsxouUlk|FtsO(OaAV zhP$gQ8XtAIsCVu^Ttb;?y!M;kWZ;e%)Jd zf%>?3EG8^^TIMxdbx?s6K=8^=O}l>AQ@^j|Z2^I*sZ<0HgYMh^C>Q~CHHsDSu+N=7 zCUx7np92sA7yvH;S(y93DpDTSf#V2wr942E{97Ue>PQn}OTbi2I%y{i015$WCfW}m zmDAdzSx!0s=EU6wvMFFl1OgcO!%lXOc({Q}9`6954h_)S4F95)#oGTz*O> zYV73Sp7fBsX~-EN4!xHwZ$hAkhAIHtQ}h~OgIc4x0h2t*|57pb9|0cuTemb$`7;gi z81-D?uD9A&rvdj$3BXW&9k2X{bO>mRyOHCWQ~&@+eh1@p#sX^45q%ss!=-&7^xA?Mi4q$u#P--eEo!MCaB*{ zDE;KvM2RB#Q7MDFfE3?ha1hr4(sFlo%9|Gz8jOJG|UBJOoxh{YA+ zMJH>%7TLZ2!QM?-WcyKE&j~8k|68K0R&&%+HAm zIjszkddD}*vh|g9wHn}-V5>ZMCE*|KP~I;8{s|g{lXsk2u^30ndNL|J?oN|IBJ{QH z^ktYCFBtC$bhNED@ks-ANlcU4>SXE2>`aVF=#%Pux)LBb|BH@i7(YX{XECa9FNOnJ zw~tIr4JRO=mv9yW2-ZUZ2!b`NcdRM^B$`P&UHdaF(wG2C=o6L!d}p$?a5@#hfu`Q7 zf$!R4vN60KQiH&{cuOUSUE}L_et4UaRxs9QA`JvMO2@~$u38(jC8qWAWu}pz_C#zQ zBJbF-rC@Cf^`$+0T%EJYZ}=f{NM!bI(9M#eno7rwlKt&k5jtEsBy>VBnG?aacp2j_ zkpkby3>%RW;Hx3zNWVmiH}FYG?C<%v=EeBc#OaLBShcoj`%w)HMf=;Cehu`|7=#{V zV8=7$hJ8_E^F4n$1DOOdOAoBA?Z$B}&y$F^CI;`{`5P!w%BsHXbK76=4vy20tz^AU zxUSgJ$D1tajZTxI3&I4>r%y9azLHjAn)Pqd=2S{CEzSIxVRjQu{v77j=0h5s*FJTh zIW2^kz2$t4Qa{{{dsk%jkcmAJlgTG&M1$~-_eO6_#sRg7ogdpe3lmf`;@Uy8LjfI< z(kx@fks#+Mi~@0y7(XqDGx!9;FLq|m3zTUSPq4b2Nq3He zMoW3#j$rYhh!65%PB^aTj~z!FJ@Zxl{Jm7nl={c?$&p2bX#8lSN(|~p{zmR6C!4&4 zRP|@1g@#_rlop>UW2#fJ$v&gjamw-b9;BR};+xTTh@%TMQ2?KW!(yITv6Bw&m5E(g{u|j?ZL(8+KA!Po6rs(Kqg-(Nh$vu=PJNDawSlB%CLsupSkF;j& z1?YR5hVpB;VxC9F7rTZ= zv8KD|B3nrl#!lYfV;-$*lSw6!qGhoL)Vy30F{c+ig-$q^)(V(kT@a238$wwEgTiLw z)uHe$j|PeM_4RGwr4#xSU#17MOy0}PaXeOq{TQ?cip`lAJ*ze3`lpG(&-3cuJfj)I zUkK`K_OZyof;6@#1q+nE^;(mp2<$Q=xjTZuiTClR(_6^Wav;`>a%6mrg(0Mabz4!-d_8Ht>_*AP3&fJ4(dprLU>jrbzQ*=Y?aG1bH-7vv!MpP1SDIViuu3{Eg2^S_$93ZSUIFDwWm4NHTt(k;z` zbk_n>g5c69AS_)g3nJ38fJk?TqN{XENP~2DrwGE*`hV!png7n4*_k_UZoK>Mx#xc8 z``(cp7jO|QUc@u`8LlC(jNL4?e6kry3|P0uEcU<_TK>eNte9Evi+{Vez` zs?O#rUF>mMX`^UzdlF*>g-s>_q){0we0y<6P3+D`^mw4VRu-RJg`t1vO@wKccg?$0PrUgChF^)Q=M*1WdAERmocvq;PMcT0W!om!vl&@cOWxl{+@ z2Yvk;q4Ob%}g1F6SEwDc&bJX9=L>xLxLG;i^BKSrgx4$t;m z@tQ5VP>w5fgcGfMu;M%lwdQMe@`!uFPq zW_M25l|z5CXxL&yNxZCT~l zxqZ1MhEVWzhz`6q4qU%R=1z9twwrNll`t`}R^RWRT?oNw4BsS^>M!S5wE?)6B!yP+hj(sH1{0tfm+h z^Wxwb4{Wk(Ej8tM*t#&sxB`wIP3BQGttp#%Tj1mUWX$(N^@Fn2hlL0yJNVYz)Ys0C z)EEeK#$Y0YiYwsU#^Bod05FWSIek-GT`#E?I20HEonwkggi}rbhY}4cRv@rhpABBB zIz2I=n(Ub!USOgI(>Th`3p(q-E2QT$!8Sx8AYg{*<0HU@@*QLRt89c|iYJfU2j zbmWg4>Sbl^$mZ@K+nV>SV+IZA;8SXxV_)WnzLtNgf3#Y}n(KCF!`mbb|P@ zSW6xXZna}CntC4OyZ#7qbg9&YC#}?4$}&PYWFe(>JE8MVj!B)`b2`~eq2fnJ_H5^j zo2TLkdzjassh;Wm*t4lNci5M-sw7pyPBZ%8{4M{GIHBe!tsKHFvLii4^}$;lIs0Uf zWxNmJMCd|Si4+?%ueC9vYT_6|hv%g;#wqXZrqk#RY;8A|9x_#Wh(Tqw^ypdV6DitS z=dPYaSV0c+>O6jZB6v6i8ck{RG&0<}JZ_<&#y!)!pH>>vZ1=g4$6B#<^r-yk6ahcl z`ND?(E)puhMg{k~fd!;+O{Cwpa9mfbJ|CGsj2iX(=ijYFTkafn*96*gnhGBPT_z*s zaZ>qxS}JdS?h7%>>airx*NC$*%dB z8ni?Gxh&xG(;%78J^M-d#lvSi!JK@{v}oFx&UCS~?W{DF)f9TUZ7wUvU*$&xBpLrk zRKO#8tT3j#lDb8oTrhfduMBX9gQMY54U`eV8Zs3kz(5?J^K)S{r$bQzBAh7EKKBQ7 zr-|Q~JFC)-6n1GYMZDvXg6iF3Z`GM-Y@;5M6`3b*-voUGG3gCsC~M1U`^S7tnslO= z86;J2(Qk9AlK4%hfk=ZsD7AK3<^a)fgp6+@%SV#xg2##p#NH=ql9p%1?7}=zRx14Q z&9c6&ETOob(kt($dRF6t@W_Hnmhw=b!gJ&h{I;E4;mcf((ooq%jk?4MQkiARvmc%4 zCwev7(c8QRz(UWtW&j)_lu%j(jg(ojcHrrfehpt(hhu)&$Uy{SWmb&!?0Q`2S=@nh z$jn_#SWsp;=`HU0H>e zNAl}@QzfwCt%T4@Qa*GoLkJkB1cnn^<|&v+pNEO&CC`nf9L4kGLg?SO&bCtx{rVwC z=C5RlRh1S_ui7FWz+8s_r=VoFOwQA3nZQm;U@2WPxa5iO*5wMnhJn7LuIB6qT&A<7 zx7?$ecSp=?RLn1l@8qjkH1&rXU;64@u_R=A7wIa|1CdX|Of;83owhX7mbdCsZ{WKm z-^9%HdP@Jj6m)4e#z6Yx;;ylOk`M@1m^BL`!4$fc181a%c5|7}T} zHs4VCp8A5tfe=$3wdtn#Y+;Am>RVn}rWWrzcQ<*2sX<}V#O=l8&tt*ZurR=2D{d@# zXHia#K%_!m8O@{=x21k4v9`TFIA3FQx<(#(li*v3#t{hpbA&5Ge=j}=G4cPqA3-#c zIDk@O4ph-hu{LH4ecChS1;``K#qZq0?!fXn^xA*WroY)SpR*3IY4(dN9bOWP*BKcf zQ;G?zPMq8pgAOGi)ymib(rP5O$ajfr3K4Lmc3)0%>--P&*<;#=3VxRW9MX{_z0eQ< zfdUTOe;Da7fSP_ysQ&|>otzq_{K3KYMoy1PL@>UrChSKSyQra76n&Xvr@fWe)csj; z1?}(2u!QoPqb`p;p96(s_-`gRt3Vck$YDvJ0xf$lseJP!`&kB4!fHqFu<$C+93}4u z9SROn*B~d$M~J8^HISm%8V|XgU8f8HolD|vBs~&b&O*_+<8;Vok)`Cic9QdU1+R#X zMrJij?IWYbxMuUmkJB?UmVO%ZWx)LXyfKT*%Pl7jKVp4yYEQgK{FSA4{3C^(k-uYy zWlq;^dd~6ste1Yq*!LFEEDYjEH=G)7pnn%l{_g$euuoKL$3~Ftm}5;Uc?Qv|diq!k ztKOf_V*%%xOmyY3P=g;P^wQTGLk?(78ZSaMeSO_HE-VM?t6p&M-?3S$0^t&$9WZo- zPsiFB6yP><*5bn0vfpdT^Kz~Bmg|-<7;b_%!GS;5m-``)K7sr~M)y1>*E~`#MEM>% z%(4d*H2q+|IM@w~KapI_ULL(b-~C%TqU_G@T$bxaNimlq>ux8F%Q9|eRHY|oaU%YF z39}MKh>vXkb&Tg9=_H46J-BOnSCKeSqfDXOR!BjIt^~UsbF%RGQq1%&h^qEf|7(Io zDpz#nS7mm`IoajBDH!ld4EohviQOk4q%!@nlm>PeQ>OHZuvmEP-9egA(__H};nPbP zhQLw7hJ8P1?81>^13#OYYTXM0s+P-*H_uO&yggJ5M8~NOV3xlp?P_G&KlU^wjWi@j z@|#G_29yT%8$9B6d!-r6ov)D9Car2pnfnu`4we+Id4%x*ZyDDV%nw@CTs=;Y43g1F z+*IeaS`LHwzxWoTuRQ0PrWbzBv@=v?H;st*(2r*=gJL;eD9OIvFn+b}CNWVfI^)30 zqqmLOxtSR721Q?yhe3j8{alve52@OU=&Lhu`I9HC^mAEd7`wGCq{) zCL!+4`?D(A3(N-atVypv6MxHXLH2VZJgPE;f>Yl=6iSzZeado_gy1ffn9cP;o*@en z?cUP_t^95rMMYn!`UmCB6y7*u??_BCt#68l>ko%hnW5n|S4KT&Sdmw6M9L=Fn*zT~ zbbih!bQs?7%@jym#rLegN1kw-G#Jl4Bd^?brUv3k3wK*z{b+FJ%HVsJ<6^Sg(G*e4 z0AFjRSrNN)DsDbFRE2HFt{cW8Y-dZLZpdbSD$EEU>Tzk>2jp5*$gIxk_TbAlb*PN9 zkQnZ`A9^peVSez-BPd*{Beyrs(T#ANxY~W|O&o~F3!l%uqK_G-9xuzOfVqIs?E5gl z?Ls3Ido2h_Sjmq~Yu#Kn1!wh@pSNMr;LSj5LRgpvsY1cRHhpzViA{&2HJKwv;p;3$ zwB+_BCXeVG>t3cL_V z;objuyV8ASK9&{Dan5ttb&<7_ei1#(>ke8F{_6jmj1&B8`X!5Tr97&EppxC^iA=T! zolerI;7i$os{=RcYH9j4tbt(p0SUp6uWhk3YA<`LG1-|`-~&dSwioGjPDN#1F$ctu z)=tk_)o;*V`{7ohG@PouxV@ZtpNk<24ORERhY8e|l+Ti#!g+Q;o^4Y}{-jSh=-0jR zU%Q`TTFcAR-4D-|=VUk9_=zh_Nvq?)f!atQr8s0%YHeDP?$}gvvfkVU0Me>7BC1U7 z@a%vl%N&4a*05*vfXRZrnh~EeN}2@ZDx>%GK0-`t`q9C{Bt~Y?lrP@2PJ1c%^*bP` zO^UE-_U+@)@z%Y2lL;GMg;JW8m4p@OZ5)kA+^Uf{=ie?kGr09UPw|QuK5t?G)4#3% z5mLd8X3YK|>0cp>rxfB^KVtdpTfG=Y?JwUHt!F7kQZ)x`IVAgo_MY0;CVjlP^;Xax z^CaeK0B6P5VV1!i=gGNnPZxoc0IL}Q>Nar^SKIyNgjRgPfSl_8&_fY_OY*;9sGWSy zjZy+yN@SF1oVIiX@Q)En8Z~1L&fSSG_{ej!$2jBIlk!5})Z2;8bp%WHW? z<9`JQ*fY=2d$+EoUfajlDk=){$@$ +Horizontal Federated Architecture: -Advantages of the MindSpore Federated ---------------------------------------- +.. raw:: html -1. Privacy Protection + - The MindSpore Federated framework data is stored locally for training. The data itself is not exchanged. Instead, the updated model parameters are exchanged in encryption mode. +1. Privacy Protection It supports accuracy-lossless security aggregation solution based on secure multi-party computation (MPC) to prevent model theft. It supports performance-lossless encryption based on local differential privacy to prevent private data leakage from models. + It supports a gradient protection scheme based on Symbolic Dimensional Selection (SignDS), which prevents model privacy data leakage while reducing communication overhead by 99%. + 2. Distributed Federated Aggregation - The loosely coupled cluster processing mode on the cloud supports the deployment of tens of millions of heterogeneous devices, implements high-performance and high-availability distributed federated aggregation computing, and can cope with network instability and sudden load changes. + The loosely coupled cluster processing mode on the cloud and distributed gradient quadratic aggregation paradigms support the deployment of tens of millions of heterogeneous devices, implements high-performance and high-availability federated aggregation computing, and can cope with network instability and sudden load changes. 3. Federated Learning Efficiency Improvement - The synchronous and asynchronous federation modes and multiple model compression algorithms are supported to improve the federated learning efficiency and saving bandwidth resources. + The adaptive frequency modulation strategy and gradient compression algorithm are supported to improve the federated learning efficiency and saving bandwidth resources. Multiple federated aggregation policies are supported to improve the smoothness of federated learning convergence and optimize both global and local accuracies. @@ -41,6 +43,31 @@ Advantages of the MindSpore Federated The network models, aggregation algorithms, and security algorithms are programmable, and the security level can be customized. + It supports the effectiveness evaluation of federated training models and provides monitoring capabilities for federated tasks. + +Advantages of the MindSpore Federated Vertical Framework +----------------------------------------------------------- + +Vertical Federated Architecture: + +.. raw:: html + + + +1. Privacy Protection + + Support high-performance Privacy Set Intersection Protocol (PSI), which prevents federated participants from obtaining ID information outside the intersection and can cope with data imbalance scenarios. + + Support encryption scheme of Label based on differential privacy to prevent leakage of user label data. + + Support privacy protection scheme combined software with hardware, which can reduce the number of communication rounds and communication volume compared with homomorphic encryption method. + +2. Federated training + + Support multiple types of split learning network structures. + + Cross-domain training for large models with pipelined parallel optimization. + MindSpore Federated Working Process ------------------------------------ @@ -48,13 +75,13 @@ MindSpore Federated Working Process Identify scenarios where federated learning is used and accumulate local data for federated tasks on the client. -2. `Model Selection and Client Deployment `_ +2. `Model Selection and Framework Deployment `_ - Select or develop a model prototype and use a tool to generate a device model that is easy to deploy. + Select or develop a model prototype and use a tool to generate a federated learning model that is easy to deploy. 3. `Application Deployment `_ - Deploy the Federated-Client to the device application, and set the federated configuration task and deployment script on the cloud. + Deploy the corresponding components to the business application and set up federated configuration tasks and deployment scripts on the server. Common Application Scenarios ---------------------------- -- Gitee