May 22, 2012 – Saving BibleServer Data to the Database

For 3 days now I have been working on a website that will let you search the Bible. I’m wrapping it up. What slowed me down the most was downloading the data using AJAX, and then the fact that I spend half the day slowly working on something and in the other half I realize I should have done it completely differently, so I delete it and write it again from scratch. This happened to me on every one of those 3 days, it’s simply a case of the left hand not knowing what the right hand is doing :/. Right now I’m building a word index for faster searching. Numbers are indexed too, and the results seem to be correct and are quite interesting:
Results when grouped by the first letter only:

  • Single-letter words: 18
  • Words starting with S: 3654
  • Words starting with N: 5385
  • Words starting with J: 1190
  • Words starting with T: 1181
  • Words starting with D: 1695
  • Words starting with H: 1230
  • Words starting with A: 970
  • Words starting with K: 1594
  • Words starting with Z: 308
  • Words starting with Z: 3482
  • Words starting with C: 1076
  • Words starting with M: 1532
  • Words starting with R: 204
  • Words starting with O: 2823
  • Words starting with P: 6424
  • Words starting with B: 1384
  • Words starting with V: 3723
  • Words starting with U: 1442
  • Words starting with I: 144
  • Words starting with L: 785
  • Words starting with R: 1477
  • Words starting with C: 299
  • Words starting with E: 454
  • Words starting with S: 676
  • Words starting with 0: 7
  • Words starting with U: 267
  • Words starting with A: 18
  • Words starting with F: 122
  • Words starting with 1: 43
  • Words starting with 2: 31
  • Words starting with 5: 12
  • Words starting with G: 294
  • Words starting with 7: 18
  • Words starting with 4: 17
  • Words starting with 6: 23
  • Words starting with 3: 25
  • Words starting with D: 10
  • Words starting with X: 6
  • Words starting with Y: 3
  • Words starting with 8: 13
  • Words starting with 9: 15
  • Words starting with N: 2
  • Words starting with I: 2
  • Words starting with Q: 1
  • Words starting with O: 1
  • Words starting with T: 1

If I look at the words by their first 2 letters, the results are as follows:

  • Single-letter words: 18
  • Words starting with Se: 409
  • Words starting with Na: 991
  • Words starting with Je: 408
  • Words starting with To: 85
  • Words starting with Do: 688
  • Words starting with Ho: 289
  • Words starting with Al: 37
  • Words starting with Kd: 29
  • Words starting with Js: 11
  • Words starting with Ta: 157
  • Words starting with Ze: 75
  • Words starting with Ja: 219
  • Words starting with Za: 1372
  • Words starting with Co: 33
  • Words starting with Si: 118
  • Words starting with Mu: 53
  • Words starting with Re: 100
  • Words starting with Ab: 143
  • Words starting with Od: 747
  • Words starting with Pa: 349
  • Words starting with Po: 2587
  • Words starting with Bu: 85
  • Words starting with Pr: 1448
  • Words starting with Me: 78
  • Words starting with Ve: 245
  • Words starting with At: 1
  • Words starting with Bu: 6
  • Words starting with Ti: 72
  • Words starting with Sv: 341
  • Words starting with Ji: 167
  • Words starting with Az: 1
  • Words starting with Mi: 202
  • Words starting with Te: 132
  • Words starting with Pr: 1053
  • Words starting with Vs: 54
  • Words starting with Uz: 31
  • Words starting with Kt: 20
  • Words starting with By: 48
  • Words starting with Ze: 153
  • Words starting with Ty: 29
  • Words starting with Ja: 54
  • Words starting with Iz: 59
  • Words starting with Va: 96
  • Words starting with An: 72
  • Words starting with Te: 74
  • Words starting with Kr: 267
  • Words starting with Sy: 48
  • Words starting with Ke: 93
  • Words starting with Mu: 8
  • Words starting with Li: 120
  • Words starting with Ma: 34
  • Words starting with On: 39
  • Words starting with Me: 180
  • Words starting with Bo: 197
  • Words starting with Ne: 60
  • Words starting with Ne: 3800
  • Words starting with Hl: 224
  • Words starting with Tv: 81
  • Words starting with Ni: 11
  • Words starting with De: 99
  • Words starting with Me: 18
  • Words starting with Tu: 51
  • Words starting with Da: 138
  • Words starting with Dn: 22
  • Words starting with Na: 282
  • Words starting with Ka: 213
  • Words starting with Ni: 105
  • Words starting with Sl: 300
  • Words starting with Vz: 3
  • Words starting with Mn: 29
  • Words starting with Sa: 44
  • Words starting with Vy: 1684
  • Words starting with Jm: 28
  • Words starting with Ru: 58
  • Words starting with Ot: 155
  • Words starting with Mo: 258
  • Words starting with Kv: 31
  • Words starting with Ob: 677
  • Words starting with Te: 9
  • Words starting with Sr: 64
  • Words starting with Zn: 159
  • Words starting with Ch: 732
  • Words starting with Vz: 358
  • Words starting with Le: 181
  • Words starting with Be: 372
  • Words starting with Ce: 108
  • Words starting with Zi: 90
  • Words starting with Ji: 36
  • Words starting with Cl: 17
  • Words starting with Du: 41
  • Words starting with Sn: 100
  • Words starting with Eg: 34
  • Words starting with Vl: 134
  • Words starting with Mi: 88
  • Words starting with Ti: 17
  • Words starting with Za: 260
  • Words starting with Hr: 72
  • Words starting with Va: 71
  • Words starting with Oc: 55
  • Words starting with Pa: 101
  • Words starting with Br: 96
  • Words starting with Dv: 80
  • Words starting with Kn: 43
  • Words starting with By: 29
  • Words starting with Sp: 434
  • Words starting with Sk: 246
  • Words starting with Vi: 95
  • Words starting with Ri: 68
  • Words starting with Tr: 88
  • Words starting with De: 110
  • Words starting with So: 197
  • Words starting with Ca: 23
  • Words starting with St: 654
  • Words starting with Ke: 6
  • Words starting with Ko: 391
  • Words starting with Se: 177
  • Words starting with Sa: 181
  • Words starting with Ve: 176
  • Words starting with Du: 47
  • Words starting with My: 41
  • Words starting with Dc: 12
  • Words starting with Jd: 11
  • Words starting with Vo: 121
  • Words starting with Ma: 338
  • Words starting with Vt: 10
  • Words starting with Os: 237
  • Words starting with Up: 113
  • Words starting with Ud: 80
  • Words starting with Vu: 19
  • Words starting with My: 8
  • Words starting with Za: 43
  • Words starting with Sm: 195
  • Words starting with Uc: 53
  • Words starting with Vr: 159
  • Words starting with Sa: 115
  • Words starting with 00: 1
  • Words starting with Uv: 115
  • Words starting with Oh: 142
  • Words starting with Hn: 58
  • Words starting with Zp: 168
  • Words starting with Ol: 44
  • Words starting with Da: 65
  • Words starting with No: 101
  • Words starting with Sl: 38
  • Words starting with Dr: 140
  • Words starting with Zi: 16
  • Words starting with Vi: 60
  • Words starting with Ra: 54
  • Words starting with Jo: 208
  • Words starting with Sh: 85
  • Words starting with Nu: 24
  • Words starting with Ov: 62
  • Words starting with Vs: 62
  • Words starting with Am: 115
  • Words starting with Ro: 1024
  • Words starting with Zl: 128
  • Words starting with Ct: 56
  • Words starting with Pe: 188
  • Words starting with Ml: 107
  • Words starting with Dl: 41
  • Words starting with La: 42
  • Words starting with Lo: 111
  • Words starting with Us: 174
  • Words starting with Uk: 125
  • Words starting with Ju: 45
  • Words starting with Zd: 125
  • Words starting with Ud: 21
  • Words starting with Us: 32
  • Words starting with Uz: 12
  • Words starting with Pe: 55
  • Words starting with Be: 59
  • Words starting with Tr: 246
  • Words starting with Zu: 30
  • Words starting with Ar: 13
  • Words starting with Di: 53
  • Words starting with Ps: 16
  • Words starting with Ci: 32
  • Words starting with Za: 45
  • Words starting with Vc: 22
  • Words starting with Ka: 47
  • Words starting with Ci: 44
  • Words starting with Pt: 35
  • Words starting with Fa: 46
  • Words starting with Ry: 47
  • Words starting with Ra: 131
  • Words starting with Ba: 204
  • Words starting with Ac: 2
  • Words starting with Pi: 51
  • Words starting with Mr: 65
  • Words starting with Bl: 112
  • Words starting with Zv: 188
  • Words starting with Ny: 6
  • Words starting with Fi: 37
  • Words starting with Pl: 260
  • Words starting with Op: 242
  • Words starting with Ce: 109
  • Words starting with Hr: 208
  • Words starting with Se: 1
  • Words starting with Ac: 133
  • Words starting with Ez: 34
  • Words starting with Si: 43
  • Words starting with Ta: 34
  • Words starting with Ok: 100
  • Words starting with Dr: 38
  • Words starting with Ut: 138
  • Words starting with Ev: 11
  • Words starting with El: 149
  • Words starting with Rt: 4
  • Words starting with Hu: 4
  • Words starting with Km: 29
  • Words starting with Us: 40
  • Words starting with Pu: 70
  • Words starting with Ci: 88
  • Words starting with Ef: 51
  • Words starting with Di: 61
  • Words starting with As: 63
  • Words starting with Zi: 32
  • Words starting with Ut: 50
  • Words starting with Ih: 2
  • Words starting with 10: 4
  • Words starting with Br: 23
  • Words starting with Ur: 17
  • Words starting with Up: 25
  • Words starting with Vy: 197
  • Words starting with Ct: 22
  • Words starting with Zb: 160
  • Words starting with Kl: 158
  • Words starting with Uz: 96
  • Words starting with Lz: 16
  • Words starting with Es: 5
  • Words starting with Oz: 78
  • Words starting with De: 16
  • Words starting with 12: 6
  • Words starting with Ur: 92
  • Words starting with Pi: 73
  • Words starting with Kr: 94
  • Words starting with 20: 5
  • Words starting with Ul: 73
  • Words starting with Zc: 11
  • Words starting with Jh: 3
  • Words starting with He: 81
  • Words starting with Ul: 20
  • Words starting with Uc: 65
  • Words starting with Si: 32
  • Words starting with Dy: 14
  • Words starting with 50: 2
  • Words starting with Vc: 7
  • Words starting with Ba: 33
  • Words starting with Um: 94
  • Words starting with Zr: 100
  • Words starting with Ar: 135
  • Words starting with Si: 99
  • Words starting with Ca: 12
  • Words starting with St: 49
  • Words starting with Ku: 57
  • Words starting with Ci: 39
  • Words starting with Zh: 69
  • Words starting with Ga: 8
  • Words starting with Uc: 9
  • Words starting with Le: 41
  • Words starting with Lu: 34
  • Words starting with La: 115
  • Words starting with Ku: 20
  • Words starting with Gi: 68
  • Words starting with Zm: 130
  • Words starting with Lu: 10
  • Words starting with Eu: 12
  • Words starting with Hv: 14
  • Words starting with Ge: 96
  • Words starting with Ga: 72
  • Words starting with Tm: 6
  • Words starting with Ha: 143
  • Words starting with Ty: 23
  • Words starting with Re: 94
  • Words starting with Ed: 29
  • Words starting with 70: 2
  • Words starting with Dz: 9
  • Words starting with 40: 3
  • Words starting with Vd: 34
  • Words starting with Av: 11
  • Words starting with Zu: 8
  • Words starting with Zi: 35
  • Words starting with 60: 4
  • Words starting with 30: 3
  • Words starting with Sp: 49
  • Words starting with Bi: 70
  • Words starting with Ak: 16
  • Words starting with Is: 8
  • Words starting with Zu: 33
  • Words starting with As: 49
  • Words starting with Pu: 95
  • Words starting with Um: 15
  • Words starting with Em: 21
  • Words starting with Or: 35
  • Words starting with Ru: 12
  • Words starting with Om: 54
  • Words starting with Zt: 80
  • Words starting with Re: 10
  • Words starting with Az: 47
  • Words starting with Li: 42
  • Words starting with Uh: 32
  • Words starting with Zj: 49
  • Words starting with Su: 63
  • Words starting with Ap: 20
  • Words starting with 25: 3
  • Words starting with Vn: 58
  • Words starting with Ru: 1
  • Words starting with Ad: 62
  • Words starting with Ne: 1
  • Words starting with Fi: 10
  • Words starting with Lv: 19
  • Words starting with Py: 5
  • Words starting with Uk: 14
  • Words starting with Da: 10
  • Words starting with Un: 46
  • Words starting with Zk: 94
  • Words starting with Ps: 11
  • Words starting with Su: 3
  • Words starting with Uj: 15
  • Words starting with 24: 4
  • Words starting with Bi: 26
  • Words starting with Py: 21
  • Words starting with Ub: 49
  • Words starting with Oz: 24
  • Words starting with Sc: 51
  • Words starting with Ra: 11
  • Words starting with St: 14
  • Words starting with 13: 5
  • Words starting with Is: 15
  • Words starting with Oc: 86
  • Words starting with Xe: 6
  • Words starting with Ve: 1
  • Words starting with Bd: 14
  • Words starting with Sn: 5
  • Words starting with Zr: 7
  • Words starting with Sb: 28
  • Words starting with Tc: 8
  • Words starting with 14: 4
  • Words starting with Hi: 13
  • Words starting with Co: 1
  • Words starting with Ek: 5
  • Words starting with Vh: 9
  • Words starting with 22: 4
  • Words starting with Sc: 3
  • Words starting with Ha: 39
  • Words starting with Gr: 10
  • Words starting with Vp: 19
  • Words starting with Zo: 62
  • Words starting with Ky: 10
  • Words starting with Zf: 3
  • Words starting with At: 24
  • Words starting with Ho: 1
  • Words starting with Ls: 9
  • Words starting with Sk: 23
  • Words starting with Mz: 3
  • Words starting with Ki: 47
  • Words starting with Zn: 6
  • Words starting with Og: 6
  • Words starting with Tl: 38
  • Words starting with Lz: 1
  • Words starting with Ri: 6
  • Words starting with Vr: 13
  • Words starting with Lh: 11
  • Words starting with Go: 29
  • Words starting with Fe: 9
  • Words starting with Uz: 10
  • Words starting with Sn: 9
  • Words starting with Ki: 12
  • Words starting with 18: 7
  • Words starting with Yz: 3
  • Words starting with Aj: 16
  • Words starting with Ur: 7
  • Words starting with Eh: 5
  • Words starting with Uh: 4
  • Words starting with Ly: 21
  • Words starting with Hy: 8
  • Words starting with Zh: 9
  • Words starting with Os: 21
  • Words starting with It: 13
  • Words starting with Su: 1
  • Words starting with Zr: 26
  • Words starting with Rv: 9
  • Words starting with Eb: 14
  • Words starting with Ag: 10
  • Words starting with Ms: 12
  • Words starting with Ec: 7
  • Words starting with Hu: 47
  • Words starting with Db: 7
  • Words starting with Lp: 2
  • Words starting with Mr: 7
  • Words starting with Ri: 22
  • Words starting with Ub: 6
  • Words starting with En: 27
  • Words starting with Ra: 10
  • Words starting with 80: 3
  • Words starting with Af: 5
  • Words starting with Dy: 8
  • Words starting with Su: 37
  • Words starting with Hm: 5
  • Words starting with Hy: 18
  • Words starting with Uc: 18
  • Words starting with 32: 6
  • Words starting with 15: 6
  • Words starting with Ir: 9
  • Words starting with Of: 10
  • Words starting with Er: 10
  • Words starting with Sy: 9
  • Words starting with 42: 2
  • Words starting with Hn: 3
  • Words starting with Sa: 6
  • Words starting with Ca: 14
  • Words starting with Zc: 5
  • Words starting with Gu: 8
  • Words starting with Cy: 9
  • Words starting with Ky: 18
  • Words starting with Tk: 21
  • Words starting with So: 17
  • Words starting with 16: 3
  • Words starting with Nu: 3
  • Words starting with Es: 16
  • Words starting with Pe: 4
  • Words starting with Zl: 7
  • Words starting with 66: 3
  • Words starting with 55: 1
  • Words starting with 76: 2
  • Words starting with 45: 3
  • Words starting with 74: 3
  • Words starting with Vk: 10
  • Words starting with Cu: 14
  • Words starting with Gi: 2
  • Words starting with Ab: 5
  • Words starting with Im: 8
  • Words starting with 35: 2
  • Words starting with 29: 2
  • Words starting with 43: 3
  • Words starting with Un: 4
  • Words starting with Ei: 2
  • Words starting with 36: 3
  • Words starting with 33: 3
  • Words starting with 17: 3
  • Words starting with 28: 4
  • Words starting with 11: 4
  • Words starting with Et: 17
  • Words starting with Hb: 3
  • Words starting with Id: 8
  • Words starting with Ik: 3
  • Words starting with Rv: 4
  • Words starting with Or: 7
  • Words starting with Ij: 4
  • Words starting with Iv: 1
  • Words starting with Sd: 17
  • Words starting with In: 3
  • Words starting with Fe: 4
  • Words starting with St: 1
  • Words starting with Sz: 6
  • Words starting with Sv: 9
  • Words starting with Ln: 7
  • Words starting with 61: 1
  • Words starting with 46: 2
  • Words starting with 65: 4
  • Words starting with 53: 2
  • Words starting with 26: 1
  • Words starting with 73: 2
  • Words starting with 52: 1
  • Words starting with Ur: 8
  • Words starting with 77: 3
  • Words starting with 93: 1
  • Words starting with Zu: 1
  • Words starting with 90: 2
  • Words starting with 59: 2
  • Words starting with 41: 2
  • Words starting with 54: 1
  • Words starting with 57: 1
  • Words starting with 62: 4
  • Words starting with 75: 1
  • Words starting with 37: 2
  • Words starting with 64: 3
  • Words starting with Zo: 3
  • Words starting with 63: 1
  • Words starting with 27: 3
  • Words starting with Cr: 4
  • Words starting with 01: 1
  • Words starting with 05: 2
  • Words starting with 97: 1
  • Words starting with 95: 3
  • Words starting with 98: 1
  • Words starting with 34: 2
  • Words starting with 72: 4
  • Words starting with 39: 2
  • Words starting with Ze: 2
  • Words starting with Ah: 4
  • Words starting with Rc: 2
  • Words starting with Cn: 3
  • Words starting with Fl: 4
  • Words starting with Rm: 3
  • Words starting with Be: 5
  • Words starting with Bn: 2
  • Words starting with Ss: 2
  • Words starting with 67: 2
  • Words starting with Bu: 2
  • Words starting with To: 2
  • Words starting with Th: 8
  • Words starting with Mh: 1
  • Words starting with Ds: 3
  • Words starting with Ep: 5
  • Words starting with Vj: 1
  • Words starting with Dm: 3
  • Words starting with Co: 3
  • Words starting with Vm: 3
  • Words starting with Ib: 5
  • Words starting with Vb: 2
  • Words starting with Fr: 4
  • Words starting with 44: 1
  • Words starting with 58: 1
  • Words starting with Na: 2
  • Words starting with Uv: 3
  • Words starting with Zv: 6
  • Words starting with 23: 2
  • Words starting with Fy: 1
  • Words starting with Ie: 2
  • Words starting with Ko: 1
  • Words starting with Rh: 3
  • Words starting with Cv: 4
  • Words starting with Ry: 2
  • Words starting with Ro: 2
  • Words starting with Sj: 4
  • Words starting with Rd: 2
  • Words starting with Rz: 2
  • Words starting with Lk: 3
  • Words starting with Ut: 1
  • Words starting with Cp: 4
  • Words starting with 83: 2
  • Words starting with 02: 1
  • Words starting with Au: 3
  • Words starting with Po: 1
  • Words starting with 96: 3
  • Words starting with 78: 1
  • Words starting with 21: 3
  • Words starting with Fo: 7
  • Words starting with Ir: 2
  • Words starting with Qu: 1
  • Words starting with Ce: 2
  • Words starting with Ku: 6
  • Words starting with 91: 2
  • Words starting with 89: 1
  • Words starting with 81: 3
  • Words starting with 84: 2
  • Words starting with Cl: 2
  • Words starting with No: 1
  • Words starting with Il: 2
  • Words starting with Sf: 1
  • Words starting with Ai: 1
  • Words starting with Uf: 1
  • Words starting with On: 1
  • Words starting with 38: 1
  • Words starting with 47: 1
  • Words starting with 69: 1
  • Words starting with Kf: 1
  • Words starting with Su: 1
  • Words starting with 03: 1
  • Words starting with 87: 1
  • Words starting with 06: 1
  • Words starting with 92: 1
  • Words starting with 82: 1
  • Words starting with Ue: 1
  • Words starting with 56: 1
  • Words starting with 94: 1
  • Words starting with 19: 1
  • Words starting with Ic: 2
  • Words starting with Pn: 1
  • Words starting with Oj: 2
  • Words starting with Gl: 1
  • Words starting with Mz: 1
  • Words starting with Sm: 1
  • Words starting with Ta: 1
  • Words starting with Bz: 1
  • Words starting with 31: 1
  • Words starting with Md: 1
  • Words starting with Ks: 1

I want to store it in a database, where there will be, for example, a table WordsIndexA holding words starting with A. I don’t know yet what to do with numbers and texts with diacritics, but I’ll probably put the numbers into a single table and, for example, merge “T” with “T“.

Categories

Leave a Reply