PHP 多進程處理任務
pcntl
模塊(非 Unix 類系統不支持此模塊)
一個 PHP 多進程簡單例子大概是這個樣子:
// 5 個子進程處理任務
for ($i = 0; $i < 5; $i++) {
$pid = pcntl_fork();
if ($pid == -1) {
die("could not fork");
} elseif ($pid) {
echo "I'm the Parent $i\n";
} else { // 子進程處理
echo "I'm the Child $i\n";
// 業務處理
exit($i); // 一定要注意退出子進程,否則 pcntl_fork() 會被子進程再 fork,帶來處理上的影響。
}
}
// 等待子進程執行結束
while (pcntl_waitpid(0, $status) != -1) {
$status = pcntl_wexitstatus($status);
echo "Child $status completed\n";
}
當然實際應用中我們不能夠這樣輸出代碼,不夠健壯,也不夠優雅,我所以找了個基於 pcntl
封裝的擴展包來使用。
spatie/async - 基於 pcntl
封裝的擴展包
以下是我使用 spatie/async
來優化一個多進程請求的例子
原代碼(耗時 20s 左右)- https://github.com/guanguans/music-php/blob/v2.1.1/src/Music.php:
/**
* @param string $keyword
*
* @return array
*/
public function searchAll(string $keyword): array
{
$songAll = [];
foreach ($this->platforms as $platform) {
$songAll = array_merge($songAll, $this->search($platform, $keyword));
}
return $songAll;
}
/**
* @param string $platform
* @param string $keyword
*
* @return mixed
*/
public function search(string $platform, string $keyword)
{
$meting = $this->getMeting($platform);
$songs = json_decode($meting->format()->search($keyword), true);
foreach ($songs as $key => &$song) {
$detail = json_decode($meting->format()->url($song['url_id']), true);
if (empty($detail['url'])) {
unset($songs[$key]);
}
$song = array_merge($song, $detail);
}
unset($song);
return $songs;
}
改進後(耗時 4s 左右)- https://github.com/guanguans/music-php/blob/v2.1.2/src/Music.php:
/**
* @param string $keyword
*
* @return array
*/
public function searchAll(string $keyword): array
{
$songAll = [];
$pool = Pool::create();
foreach ($this->platforms as $platform) {
$pool->add(function () use ($platform, $keyword) {
return $this->search($platform, $keyword);
}, $this->getSerializedOutput())->then(function ($output) use (&$songAll) {
$songAll = array_merge($songAll, $output);
})->catch(function (\Throwable $exception) {
exit($exception->getMessage());
});
}
$pool->wait();
return $songAll;
}
/**
* @return mixed
*/
public function search(string $platform, string $keyword)
{
$meting = $this->getMeting($platform);
$songs = json_decode($meting->format()->search($keyword), true);
$pool = Pool::create();
foreach ($songs as $key => &$song) {
$pool->add(function () use ($meting, $song) {
return json_decode($meting->format()->url($song['url_id']), true);
})->then(function ($output) use (&$songs, &$song, $key) {
$song = array_merge($song, $output);
if (empty($song['url'])) {
unset($songs[$key]);
}
})->catch(function (\Throwable $exception) {
exit($exception->getMessage());
});
}
unset($song);
$pool->wait();
return $songs;
}
相關鏈接
- https://www.php.net/manual/zh/book.pcntl.php
- https://github.com/spatie/async
- https://github.com/guanguans/music-php