PHP內(nèi)核探索 —— PHP哈希算法設(shè)計(jì)
HashTable是PHP的核心,這話一點(diǎn)都不過(guò)分。PHP的數(shù)組、關(guān)聯(lián)數(shù)組、對(duì)象屬性、函數(shù)表、符號(hào)表等等都是用HashTable來(lái)做為容器的。
PHP的HashTable采用的拉鏈法來(lái)解決沖突,這個(gè)自不用多說(shuō),我今天主要關(guān)注的就是PHP的Hash算法,和這個(gè)算法本身透露出來(lái)的一些思想。
PHP的Hash采用的是目前最為普遍的DJBX33A (Daniel J. Bernstein, Times 33 with Addition),這個(gè)算法被廣泛運(yùn)用與多個(gè)軟件項(xiàng)目,Apache、Perl和Berkeley DB等。對(duì)于字符串而言這是目前所知道的最好的哈希算法,原因在于該算法的速度非常快,而且分類非常好(沖突小,分布均勻)。
算法的核心思想就是:
hash(i) = hash(i-1) * 33 + str[i]
在zend_hash.h中,我們可以找到在PHP中的這個(gè)算法:
static inline ulong zend_inline_hash_func(char *arKey, uint nKeyLength){ register ulong hash = 5381; /* variant with the hash unrolled eight times */for (; nKeyLength >= 8; nKeyLength -= 8) {hash = ((hash << 5) + hash) + *arKey++;hash = ((hash << 5) + hash) + *arKey++;hash = ((hash << 5) + hash) + *arKey++;hash = ((hash << 5) + hash) + *arKey++;hash = ((hash << 5) + hash) + *arKey++;hash = ((hash << 5) + hash) + *arKey++;hash = ((hash << 5) + hash) + *arKey++;hash = ((hash << 5) + hash) + *arKey++; } switch (nKeyLength) {case 7: hash = ((hash << 5) + hash) + *arKey++; /* fallthrough... */case 6: hash = ((hash << 5) + hash) + *arKey++; /* fallthrough... */case 5: hash = ((hash << 5) + hash) + *arKey++; /* fallthrough... */case 4: hash = ((hash << 5) + hash) + *arKey++; /* fallthrough... */case 3: hash = ((hash << 5) + hash) + *arKey++; /* fallthrough... */case 2: hash = ((hash << 5) + hash) + *arKey++; /* fallthrough... */case 1: hash = ((hash << 5) + hash) + *arKey++; break;case 0: break;EMPTY_SWITCH_DEFAULT_CASE() } return hash;}
相比在Apache和Perl中直接采用的經(jīng)典Times 33算法:
hashing function used in Perl 5.005:# Return the hashed value of a string: $hash = perlhash('key')# (Defined by the PERL_HASH macro in hv.h)sub perlhash{ $hash = 0; foreach (split //, shift) {$hash = $hash*33 + ord($_); } return $hash;}
在PHP的hash算法中,我們可以看出很處細(xì)致的不同。首先,最不一樣的就是,PHP中并沒(méi)有使用直接乘33,而是采用了:
hash << 5 + hash
這樣當(dāng)然會(huì)比用乘快了。
然后,特別要主意的就是使用的unrolled,我前幾天看過(guò)一篇文章講Discuz的緩存機(jī)制,其中就有一條說(shuō)是Discuz會(huì)根據(jù)帖子的熱度不同采用不同的緩存策略,根據(jù)用戶習(xí)慣,而只緩存帖子的第一頁(yè)(因?yàn)楹苌儆腥藭?huì)翻帖子)。
于此類似的思想,PHP鼓勵(lì)8位一下的字符索引,他以8為單位使用unrolled來(lái)提高效率,這不得不說(shuō)也是個(gè)很細(xì)節(jié)的,很細(xì)致的地方。
另外還有inline,register變量 … 可以看出PHP的開(kāi)發(fā)者在hash的優(yōu)化上也是煞費(fèi)苦心。
最后就是,hash的初始值設(shè)置成了5381,相比在Apache中的times算法和Perl中的Hash算法(都采用初始hash為0),為什么選5381呢?具體的原因我也不知道,但是我發(fā)現(xiàn)了5381的一些特性:
Magic Constant 5381: 1. odd number 2. prime number 3. deficient number 4. 001/010/100/000/101 b
看了這些,我有理由相信這個(gè)初始值的選定能提供更好的分類。
至于說(shuō),為什么是Times 33而不是Times 其他數(shù)字,在PHP Hash算法的注釋中也有一些說(shuō)明,希望對(duì)有興趣的同學(xué)有用:
DJBX33A (Daniel J. Bernstein, Times 33 with Addition)This is Daniel J. Bernstein’s popular `times 33’ hash function asposted by him years ago on comp.lang.c. It basically uses a functionlike ``hash(i) = hash(i-1) * 33 + str[i]’’. This is one of the bestknown hash functions for strings. Because it is both computed veryfast and distributes very well.The magic of number 33, i.e. why it works better than many otherconstants, prime or not, has never been adequately explained byanyone. So I try an explanation: if one experimentally tests allmultipliers between 1 and 256 (as RSE did now) one detects that evennumbers are not useable at all. The remaining 128 odd numbers(except for the number 1) work more or less all equally well. Theyall distribute in an acceptable way and this way fill a hash tablewith an average percent of approx. 86%.If one compares the Chi^2 values of the variants, the number 33 noteven has the best value. But the number 33 and a few other equallygood numbers like 17, 31, 63, 127 and 129 have nevertheless a greatadvantage to the remaining numbers in the large set of possiblemultipliers: their multiply operation can be replaced by a fasteroperation based on just one shift plus either a single additionor subtraction operation. And because a hash function has to bothdistribute good _and_ has to be very fast to compute, those fewnumbers should be preferred and seems to be the reason why Daniel J.Bernstein also preferred it. -- Ralf S. Engelschall <rse@engelschall.com>
相關(guān)文章:
1. PHP字符串前后字符或空格刪除方法介紹2. css進(jìn)階學(xué)習(xí) 選擇符3. XML入門的常見(jiàn)問(wèn)題(一)4. 將properties文件的配置設(shè)置為整個(gè)Web應(yīng)用的全局變量實(shí)現(xiàn)方法5. Laravel操作session和cookie的教程詳解6. jsp實(shí)現(xiàn)登錄界面7. Echarts通過(guò)dataset數(shù)據(jù)集實(shí)現(xiàn)創(chuàng)建單軸散點(diǎn)圖8. html小技巧之td,div標(biāo)簽里內(nèi)容不換行9. 淺談SpringMVC jsp前臺(tái)獲取參數(shù)的方式 EL表達(dá)式10. 解析原生JS getComputedStyle
