From 59afa74fb1bfa37f3282035330f777229dd169ad Mon Sep 17 00:00:00 2001 From: Michael McCandless Date: Wed, 13 Dec 2006 10:08:28 +0000 Subject: [PATCH] LUCENE-738: regenerating web site docs git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@486579 13f79535-47bb-0310-9956-ffa450edef68 --- docs/fileformats.html | 49 +++++++++-- docs/fileformats.pdf | 186 +++++++++++++++++++++--------------------- 2 files changed, 137 insertions(+), 98 deletions(-) diff --git a/docs/fileformats.html b/docs/fileformats.html index 7ba69b4d5bb..993519fa21c 100644 --- a/docs/fileformats.html +++ b/docs/fileformats.html @@ -1346,7 +1346,8 @@ document.write("Last Published: " + document.lastModified);

Compound Files

Starting with Lucene 1.4 the compound file format became default. This - is simply a container for all files described in the next section.

+ is simply a container for all files described in the next section + (except for the .del file).

Compound (.cfs) --> FileCount, <DataOffset, FileName> FileCount , @@ -2068,12 +2069,23 @@ document.write("Last Published: " + document.lastModified);

Deleted Documents

The .del file is - optional, and only exists when a segment contains deletions: + optional, and only exists when a segment contains deletions.

-

Deletions +

Although per-segment, this file is maintained exterior to compound segment files. +

+

+ +Pre-2.1: + Deletions (.del) --> ByteCount,BitCount,Bits

-

ByteSize,BitCount --> +

+ +2.1 and above: + Deletions + (.del) --> [Format],ByteCount,BitCount, Bits | DGaps (depending on Format) +

+

Format,ByteSize,BitCount --> Uint32

Bits --> @@ -2081,6 +2093,20 @@ document.write("Last Published: " + document.lastModified); ByteCount

+

DGaps --> + <DGap,NonzeroByte> + NonzeroBytesCount + +

+

DGap --> + VInt +

+

NonzeroByte --> + Byte +

+

Format + is Optional. -1 indicates DGaps. Non-negative value indicates Bits, and that Format is excluded. +

ByteCount indicates the number of bytes in Bits. It is typically (SegSize/8)+1. @@ -2096,10 +2122,23 @@ document.write("Last Published: " + document.lastModified); Bits contains two bytes, 0x00 and 0x02, then document 9 is marked as deleted.

+

DGaps + represents sparse bit-vectors more efficiently than Bits. + It is made of DGaps on indexes of nonzero bytes in Bits, + and the nonzero bytes themselves. The number of nonzero bytes + in Bits (NonzeroBytesCount) is not stored. +

+

For example, + if there are 8000 bits and only bits 10,12,32 are set, + DGaps would be used: +

+

+ (VInt) 1 , (byte) 20 , (VInt) 3 , (Byte) 1 +

- +

Limitations

There diff --git a/docs/fileformats.pdf b/docs/fileformats.pdf index 947d3d26ddb..d77e911a44d 100644 --- a/docs/fileformats.pdf +++ b/docs/fileformats.pdf @@ -454,10 +454,10 @@ endobj >> endobj 81 0 obj -<< /Length 2012 /Filter [ /ASCII85Decode /FlateDecode ] +<< /Length 2031 /Filter [ /ASCII85Decode /FlateDecode ] >> stream -Gatm=D/\/e&H;*)+lpfZ+D1:!$Q')TBiCfUdV^qN!m<:E&nQ.5MbD34]O/F;A6DEjFPNMulA2b6Gk]uVG=Uc>I.D/=q)35o-2`6WM/?^+@2QkZ+#MTu^l+!b`0Of^@e/jGc*IJ3)j:grrouDG*#H>WB+qnBZJij/3m#/`U$Z(U_YWlpIT,$BQD[g8e89>6E]ICV.lJq(rsu63bjZGaK'nA)J]g$sM%uRNKE\`"&4.n46`U%15Qt?7ms%_fa+BKiS_TYn'o>8d:D@'W*s;;\eV5;l7#2,Y-&]Gam2I2duK\%)KC$iA0(j@L<\4&j<02=0Aqci?P$nG)BRbLX8VZqH:L)JVch4`%gLM)GCsQjFqi9/'%d\FP=^l*5^\mK4eTLi+one1^qED.d:MK]gj`k(c=)id]4icr/$&OSur`EU\40B%T.O.GkLW&eZF+t09G<^7B*&udBY>tEB,]gp;*:/YAeQcFX4AhP_]qRLbJIG.j=GnY;;X4!j$rUgXhFbn5fU"`E'^mQY%4^hQ!FZ_=-mhe%P*+&MT$0p"V)8f!@LdMoA5U\8[:FQ;ke,Q@NM'o4\/@6jM"25I+Uf2?.,O9o4kbp2$_S#?D/b#6+5LuXr]hRifIA36CF3e,d`"En5^5`_@L_I*BKMCG#;Cu&X\nr[fstN%j";U2:l%+:D,eC#Q^(tEZ-oF*'TT9R\i\'8?68W)V)'YZlD)?38t3E<0)pr[b7=MW,U?c$HX-u\Up0:Jgu(sfOJR,`bcQ@%u!NjF+WOEE10LsFi/EEfds.fB=egJ@9'0CUJ.180:8'-hTR'Va/Os/(*!P_Rg\XWAQT.oTNHZu,VW%>PB2S6eNTf>4U%EfRTLF0W>oC$KJ=3,YjFpj(LHS8M&JpsO/bj,lml5d=Tk\\$hAT,k.^^nWhST_"\g:?Z;dSH3VBE`sXFF)a7`S\HdT.JgF#"86JD@H#9XVpfd5tD4$T7AdVi7\@tW6hK@p;VXdJqPfYA=GL-*lK05>7WJ-6p]IXXq*qC0T5_fqRtmf@-nn8N.gctLikYOTMbce]1lB#X,on+95BBLZUIP/.T[QB,%0YSo)Z1h:du[mA'$>&]*00-$/9(^rikTNb@/Vl`q!rme,dc%)I?`'/sUI8(O";7r*24P?G7Oq(l +Gatm=D/\/u%/ui*+lpfb+MR,H(,-0\>Da+`g9&@q?l=^*FL#i6MgHg!nUCEbag+H?Qaf=#eBuA^O*o$(j=.8KBC?UKhp*3W"omJP`AY')0FZph&";fei'kit@S7#CH1pRWlR)iU2eF4Zr8gpd3A,]caNj-Qb(_"Yl6HIuKsknO$L?"S2r!=aMEJSVAo=[8L"+"_]b\LPbQ#qhapa>NV>+q1AsF8M2jGlLMt.L[6/Ts-A-Gu:a9HD@]$I!"Wcp;mP0'YSkc.[*X,'?nF5CfFgd/_r^h8LLLDKWXr`9_*aA*fmg29?"6SJ-"\cN-D@XGB(o+58"\rR:?AD0d3a?^YZo;KBZ$1eSO!"WGUc^/@aLR)e,1&S+ElDMLI^q;D,:LEb&W1j)Qm#$'3a48`nk#q;DO'pTeKd<2c[,^[UjbR+?RY+Y!k'>F=j_J#dh@]Z6VeaL^0nph<0+=_eh;mkI,"\^O=.:IKt$Y[k+qmb[:AChWh\$i;1Y^FFBe7JOeFCA3!uJp*hW`W9:Z2/g59Jg`J'5HH3G0>V^=&G/ud13b@Lt]DJkVikXf%ImrUWON`P-37qGPWk#E/AO;i$^#h6CfHZ*Xf(o-$mN(fDagrPp(\)D`LG"d"6Fqh+A>(Y@M\VZ)Zilb;3i'a(R:j-H_SQi/rapF#iLaUBFB$8qCN*g]STN%Nih-:K(-tdONq17Q'NY01SbUN]9WFeK%NB2B0#&(%+,YOGqRk&A2Z`;Y0so]?^0X[penl'HR_0.@qWtBf;+*%H#EAZ`$cim2eP#X"r3B13(mN&35'oQaag?9_OM"=Ji/"diET4UUsaOh&$hc\+NG=7/2&=?L)0G9[[+_k'pn$JLuEA(4M6W.A#f(c0oj"rhA<8";gq2[EOL#Fu0.C9D6H^R)J!O4iVKh[odb:=NFC$Ch]$OcUWGMMuKFg/p`4[?eeO0Iuh?<)^p!qC_Adf?%f%nkNk_af3XDP09&$el"WgfcGktdX#fi!1AX;9jf]S@R(TAPMmgGlT38W]fOH5gDA*Hp@_t*1Rn>0PO&`Li8O"b\%LjqZ:kXR[s@NK@Q#Mpg_pJURO4Z!nAC",hN%uf`9cBbVj06hSBZC,K,Y"H+0-a]-aX$(^ldJlK8qUmOp3LE32G:`(ds;ApEo$uX]2A#jcsW+J`^H;7o4$[n@h,JDg9\V&epfp$=-?c_lXeZ?2&EpiD0E5DRe(,R+.nn%hYA1Fp&KA^(f8E%@TVJonCJTZoRj54PH;&RBPgd0lkpO].+"rfSomViK#&jPd37W/=7%jfBEUGfdXI8[ipN;BGfY3cEMmW$]!:3#hU^?Ep`]rQ.>X+f%&TeC:Mg.Ht>jM.j!N@h-6X3S8?^2n0\SDmXNA?,=2~> endstream endobj 82 0 obj @@ -559,10 +559,10 @@ endobj >> endobj 95 0 obj -<< /Length 1510 /Filter [ /ASCII85Decode /FlateDecode ] +<< /Length 1543 /Filter [ /ASCII85Decode /FlateDecode ] >> stream -Gat=+95iiK&AJ$C&@j&P@n*7^4c72[c#13c&JSs>c)'YjYpl/m/U8WlM>QU3b*"baa>>=I`u\qSn+gR?24se-TDY&fZr3N7P:XKMMW7h;O-oo0ARU0>$W50rj5c9CeUJWr!eMk/^RR#HW-U6Q-:)i*:k&V1+Ort"`GlH_q%ipO2A:JEr4Up8jVsV[UFGRUSkZ,T%<6l'b&d26Rf>:3'G;BgP&@2`O^]$44%(n\?!5\T8'B)0i/K+W6"h0TPbF[b(]lDU6hOk\'FJ#(K)H(0\*Mi2Yb>J71i#N40utAg!dC`!26Hq+fkqll!$_b(U/W?uhZ0TSRe)47)[N<`[<9&R1GGaZS]\\p;74ar.iQ`L!?l[A64A7K"\j3R>l*UY#_Gk2i#Pf!S:ahTKHYmZoe_(!K2:=J6;p_)3nIF'=pTl"#P%5TSQ[j$U1ZHD:*-I!TD/YE0,)3gYs5eg*4)]k'nQQ>X]@;C=7U=t(YgqPgBpPlaG=Up??4E8rq3eTl"r04>^4[pQ('qhNaC4K"/j\p$9AJM@)H("j4AXEH*Yq.d[-#e7jW9H/-mpI4Sq1D>!%NQi8$]%p6'p)g/;6^$$lG'mak2I8Q)&fRe4-PnIIi*o>pqa8f:O)32W_7-r*>%=OsKW(-@5)0kSePO_pgtMFB/ns2"ZS]lafOUGa2.p9f"oOPK;hp'iR;LU0(VdXf&)+3o?[k&s!eMBc6D;5!&^b#"hdN6pqLi\*C$L3N>=$-n^$U9g>4_+X[Qe=s+rA9bANbke=u&%^MXeV=bP8"\,&!ig%n5Jr$K7RJJA=8,\$8;cPXr:L=/U]TMP-FC:CCcC>FS+8\:?f7LZ+3,W8WZqZd0jYG:Qd69b-:`Snp4Q-ZbJ-Xq%2ZS=kG])aa,Gl?,D,"(l!"k#sF[/~> +GatU4>>HJ&'RnB3Y]p2E`/Hj&Au8b6<-B4f'rkq=H!0iL8=[UrAt5Db!3&2sp0@+W0W(KM6/q5+cL!^6>V7D=/LNb1"E!i#eKbH?JEHI6rl_hI53"K9P_Z1Kk[F&FjRPMGY^g*g[U1RF,#k`s2j9mp($H`k8._8cSDnh0cn[uGcPBFFf72<'=0\sWF#9Z:NG#TNB03X#Q<385#?q*j]I>+n3B,cm;H?]WV<=jSc7Z>o+Z)jR\0)Dl3\&2Uq-)n7dAqM^i1Ri"\J+ZFY)[9Zg;lEZP4RPT\"rP?2&oeoc(29uR^%745ZIH9=1ks4;8nr-Z>\i=oqSe'!6t_RVM.t7F9]?OQBXdS7gH4>>s*W=]$Wd^9]Ed'Hnh@AS^"boEh9]9']LlaA:;I,_:o(/J_"W<0""EKh5qn7Kl0-7&/A_:"j)L@s:jSj,Dj85NM(#]5\LGJC>3%1_8rl8jcmIVb62-@Cma"&L]Y%J(M5&Kcpdt(qdXVMd)YVTob'[3?=gMn;0pV2S)&7Fj\??<)#+S=_76VC;m*q0]ZqQ$+c-,.fF9ERK/n+PQ!sDr,#=mEM(oi'kTj+W9_n=S.p3\Ft"1!94:_[CDo7dF[/B8`!3i`Q]\c=hUY.k:/.)JP4Vs*KY?A[I.RQ7-]\e%"b1Q*mDlpQKGaa3QmDcI(%A%I?FcXh"bIFI@@)8bO)<]+EP0H`o6q4360.2UR5a'F@Q2&%aTjam[AZdil24f'0FVK3ObcDCYAfn?8K;qS*I9E@G7-'adqQsMSZRrh@:IW,oDP<'Z[*>l&GEjW*U\Y~> endstream endobj 96 0 obj @@ -574,10 +574,10 @@ endobj >> endobj 97 0 obj -<< /Length 1075 /Filter [ /ASCII85Decode /FlateDecode ] +<< /Length 1591 /Filter [ /ASCII85Decode /FlateDecode ] >> stream -Gat%"966RV&AJ$Cka9R>MM-6rlV*j@Vh[HLHY@ca+`'jR3C:[S^TRWa[-QXD4!'#TT\]Q1m=&N00&ELaVZeFeqgV]nN%u$#TtU<=0YWN0He!`/MpI=3s1Woj%L=/RdV?V<7Ek`jR2,uJ%@L#?LA\\f8TV*3em+DCDfg+JgJSfT&Y5CH>N(OLDfVPBXXZ9TV*W9[i&B-#8^V<*>#QNu<$tKTDJW83F]PK!^(G#EL_iod2tLN0g'^lR0SQfo]:H8"[MuG9!K-"`cf!q?ohN$C[mP=pd[Nna0`qldCbkrZPTVdOX;&&rLk6A[WH9RGJd?88"hPq3p#:\^=gBGA)HXR=Zd['*ZLT#qbnXAb(hcYHR5`fq'T,;O:0toWi"J]rLZR$LW53KgH?qF%JhN5nk^H@TL=G"V8_SQDtQTgRuLi@j,(7\FHmAo316,HCaUMpb9'i+RX0Vj7h&cHtgXlP5Ou9V2DDGAM/pm/e@/b^u<$m6FE9;_Cgu?OPFHonFHWZbh*LTBt@Mq,c:RA*ffS>E\Egl]\D-2GOuY>1l4QFb"#fp(/Na1lZ"nIdEMI>W,CVEX$@r4r/C/+MeEeEQ%r3i(keeJ#nNZQ3Un]aa-8f")]Xf,!&8,MCfs'q,!Q(b@QXp0&dBWT/UTbX\lZLrQCI84IM<;4rpg-Y/<@'_=m;'Kd/_[Up/b7^rD<`rRC3"?.n:b[@+eN +GatU4gMZ%0&:O:SkV5A?L=BKt;4uds6&MDGGh\"N&%"dY67#JZ;82DKG9kkh:ncYqMBK0Z,3Qs%B1?%,B0WJ1T4Z=$_=-D8U4c^an&&MaCVMMBa!&/s$#;?oD79B%m11_n@Q$>O-SsJIU@?(%rhO0?T=WT7\,NsCaXZIg^-!q9S:27FAZ@r8VGR$<_X;O'/Jd4R_T0#[NdYjED68:-Blt84Y?F4b4e^i(eeF9OnRBn=PYkmsQ%&bSb=Si'_thWapadmTZ@H!A8P.'7aklO?;cVKD?]cF=c67M)lgs\dCl`k_[^o)M1JfQ>2A8\#GDET63L**7U^;b:mb.UCMoM+=%WIB.`S&PmTlnU@==3Nkkp&@I8AGLGcWG!k%.)Qiu`'&4hjN$p@Rk'JO&]!**W0EF)P8(6*_UXTt'b=kT/,\.)]9'[*5`2DGKsZ&ZpXsXtj&i!2Z#;X#a=bb]K0:Mh'N2td5@):_:QIu=AQ:g-qVgn(YG!%Y-40bTtH;e;^6eE7W#h5p86QV0R]^j"3_sU<:Nqn.pn)i"H&&qm?`=;DO:SNkNdDQVS'tf2S:Q\o;q1>0=.6&-e)S\0,'^RoosIXK`nFRn;mB1?N5E^L2)GM0s3b5g)cd$u?hel06^EQ:YpUK1+%.>C;'54$l3"+`r1RfVnO*Rrll@B^HKI%!:\KH8.=Sctk2['cH[[CAh,4@el96#2d]MRYR/LQu_15V1q6%[]VN*VC"l=2KdMBaXtT"hkHu8OQ.;^-LP9NG,*E**l0L2EOMJI^&$W[t&l3No*bP%)Ee/Bd0)s(<\hOtnL`,So$O@1KejKI"@@ft5hm5Wc_IpQb&$e6P~> endstream endobj 98 0 obj @@ -1052,7 +1052,7 @@ endobj 68 0 obj << /S /GoTo -/D [98 0 R /XYZ 85.0 577.0 null] +/D [98 0 R /XYZ 85.0 325.4 null] >> endobj 99 0 obj @@ -1063,74 +1063,74 @@ endobj xref 0 135 0000000000 65535 f -0000042468 00000 n -0000042639 00000 n -0000042731 00000 n +0000043036 00000 n +0000043207 00000 n +0000043299 00000 n 0000000015 00000 n 0000000071 00000 n 0000001279 00000 n 0000001399 00000 n 0000001571 00000 n -0000042871 00000 n +0000043439 00000 n 0000001706 00000 n -0000042934 00000 n +0000043502 00000 n 0000001841 00000 n -0000043000 00000 n +0000043568 00000 n 0000001978 00000 n -0000043066 00000 n +0000043634 00000 n 0000002115 00000 n -0000043130 00000 n +0000043698 00000 n 0000002252 00000 n -0000043196 00000 n +0000043764 00000 n 0000002389 00000 n -0000043262 00000 n +0000043830 00000 n 0000002526 00000 n -0000043326 00000 n +0000043894 00000 n 0000002663 00000 n -0000043392 00000 n +0000043960 00000 n 0000002800 00000 n -0000043456 00000 n +0000044024 00000 n 0000002937 00000 n -0000043522 00000 n +0000044090 00000 n 0000003074 00000 n -0000043588 00000 n +0000044156 00000 n 0000003211 00000 n -0000043653 00000 n +0000044221 00000 n 0000003348 00000 n -0000043719 00000 n +0000044287 00000 n 0000003485 00000 n -0000043783 00000 n +0000044351 00000 n 0000003621 00000 n -0000043849 00000 n +0000044417 00000 n 0000003758 00000 n -0000043915 00000 n +0000044483 00000 n 0000003894 00000 n -0000043979 00000 n +0000044547 00000 n 0000004031 00000 n -0000044043 00000 n +0000044611 00000 n 0000004168 00000 n -0000044109 00000 n +0000044677 00000 n 0000004304 00000 n -0000044175 00000 n +0000044743 00000 n 0000004441 00000 n -0000044239 00000 n +0000044807 00000 n 0000004577 00000 n 0000005296 00000 n 0000005419 00000 n 0000005488 00000 n -0000044305 00000 n +0000044873 00000 n 0000005621 00000 n -0000044369 00000 n +0000044937 00000 n 0000005754 00000 n -0000044433 00000 n +0000045001 00000 n 0000005887 00000 n -0000044497 00000 n +0000045065 00000 n 0000006020 00000 n -0000044563 00000 n +0000045131 00000 n 0000006153 00000 n -0000044627 00000 n +0000045195 00000 n 0000006285 00000 n -0000044691 00000 n +0000045259 00000 n 0000006418 00000 n 0000008552 00000 n 0000008660 00000 n @@ -1144,59 +1144,59 @@ xref 0000018319 00000 n 0000020364 00000 n 0000020472 00000 n -0000022577 00000 n -0000022685 00000 n -0000024324 00000 n -0000024432 00000 n -0000025778 00000 n -0000025886 00000 n -0000027724 00000 n -0000027832 00000 n -0000029518 00000 n -0000029626 00000 n -0000031405 00000 n -0000031513 00000 n -0000033316 00000 n -0000033424 00000 n -0000035027 00000 n -0000035135 00000 n -0000036303 00000 n -0000044755 00000 n -0000036411 00000 n -0000036610 00000 n -0000036827 00000 n -0000037033 00000 n -0000037241 00000 n -0000037409 00000 n -0000037609 00000 n -0000037766 00000 n -0000037940 00000 n -0000038180 00000 n -0000038309 00000 n -0000038463 00000 n -0000038617 00000 n -0000038761 00000 n -0000038911 00000 n -0000039052 00000 n -0000039291 00000 n -0000039473 00000 n -0000039646 00000 n -0000039849 00000 n -0000040037 00000 n -0000040288 00000 n -0000040429 00000 n -0000040638 00000 n -0000040824 00000 n -0000040998 00000 n -0000041243 00000 n -0000041434 00000 n -0000041640 00000 n -0000041800 00000 n -0000041914 00000 n -0000042025 00000 n -0000042134 00000 n -0000042241 00000 n -0000042358 00000 n +0000022596 00000 n +0000022704 00000 n +0000024343 00000 n +0000024451 00000 n +0000025797 00000 n +0000025905 00000 n +0000027743 00000 n +0000027851 00000 n +0000029537 00000 n +0000029645 00000 n +0000031424 00000 n +0000031532 00000 n +0000033335 00000 n +0000033443 00000 n +0000035079 00000 n +0000035187 00000 n +0000036871 00000 n +0000045323 00000 n +0000036979 00000 n +0000037178 00000 n +0000037395 00000 n +0000037601 00000 n +0000037809 00000 n +0000037977 00000 n +0000038177 00000 n +0000038334 00000 n +0000038508 00000 n +0000038748 00000 n +0000038877 00000 n +0000039031 00000 n +0000039185 00000 n +0000039329 00000 n +0000039479 00000 n +0000039620 00000 n +0000039859 00000 n +0000040041 00000 n +0000040214 00000 n +0000040417 00000 n +0000040605 00000 n +0000040856 00000 n +0000040997 00000 n +0000041206 00000 n +0000041392 00000 n +0000041566 00000 n +0000041811 00000 n +0000042002 00000 n +0000042208 00000 n +0000042368 00000 n +0000042482 00000 n +0000042593 00000 n +0000042702 00000 n +0000042809 00000 n +0000042926 00000 n trailer << /Size 135 @@ -1204,5 +1204,5 @@ trailer /Info 4 0 R >> startxref -44808 +45376 %%EOF