2021年了，數據分析還喫香麼？

{"type":"doc","content":[{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"00|背景","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" 筆者近期因爲個人原因，萌生了更換工作的念頭。在仔細盤點了自己的技能樹後，發現除了一些服務軟技能外，數據分析可能是筆者日常使用較多的場景了，因此打算對目前市場上的數據分析的崗位要求和現狀進行一輪分析，以期待能指導自己進行下一輪職業選擇。","attrs":{}}]},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"01|結論","attrs":{}}]},{"type":"paragraph","attrs":{"indent":1,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"如果各位看官時間不多，可以先看分析結論。","attrs":{}}]},{"type":"numberedlist","attrs":{"start":1,"normalizeStart":1},"content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":1,"number":1,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"上海地域需求最旺盛","attrs":{}},{"type":"text","text":"，如果想要更快的入職且沒有地域傾向的話，可以按照“上海>廣州>深圳>北京>杭州>武漢>成都>南京>蘇州>重慶”的地域排序進行考慮。","attrs":{}}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":1,"number":2,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"北京地域給出的薪資最高","attrs":{}},{"type":"text","text":"，如果想要掙得更多且沒有地域傾向的話，可以按照“北京>上海>深圳>杭州>無錫>南京>廣州>蘇州>長沙>重慶”的地域排序進行考慮。","attrs":{}}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":1,"number":3,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"市場對學歷和行業經驗都較爲看重，尤其是事業單位和國企","attrs":{}},{"type":"text","text":"。其中事業單位對本科及以上學歷的要求高達100% ，國企對本科及以上學歷的要求也超過90%。如果個人學歷一般的話，建議考慮民營公司。","attrs":{}}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":1,"number":4,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"市場上能給出50w以上薪資的單位非常少","attrs":{}},{"type":"text","text":"，佔比僅1.4%。該類單位","attrs":{}},{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"主要分佈在互聯網大廠，如頭條，騰訊，美團等","attrs":{}},{"type":"text","text":"。且類似單位對招聘人才的工作經驗的要求一般是5-7年。","attrs":{}}]}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":1,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" 數據說明：","attrs":{}}]},{"type":"numberedlist","attrs":{"start":1,"normalizeStart":1},"content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":1,"number":1,"align":null,"origin":null},"content":[{"type":"zerowidth","attrs":{}},{"type":"text","text":"本文所有分析結果均隱含條件“數據分析崗位”，後面章節不再贅述。","attrs":{}}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":1,"number":2,"align":null,"origin":null},"content":[{"type":"zerowidth","attrs":{}},{"type":"text","text":"本文的分析樣本取樣自","attrs":{}},{"type":"link","attrs":{"href":"https://www.51job.com","title":"","type":null},"content":[{"type":"text","text":"前程無憂","attrs":{}}]},{"type":"text","text":"網站11月仍舊發佈的招聘信息。因網站招聘信息可能存在客觀失真情況，已對相關數據進行清洗。","attrs":{}}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":1,"number":3,"align":null,"origin":null},"content":[{"type":"zerowidth","attrs":{}},{"type":"text","text":"本文內容僅涉及對單個網站數據分析類崗位的招聘現狀分析，不涉及趨勢分析及未來預測。","attrs":{}}]}]}]},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"02|數據分析的現狀","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" 隨着大數據技術的發展，數據在公司的日常運營和決策中的地位也越發重要。相應的，市場上也逐漸出現了各式各樣的數據分析類的工作。如偏向底層數據技術的算法工程師，數據倉庫工程師，數據挖掘工程師。偏向業務場景的數據分析師，數據產品經理，用戶增長師等。從本質上來說，數據分析是一項技能，人人可以學，人人可以用。但是在企業實際運轉過程中，會因爲企業目標的不同而構建不同的數據團隊，拆分不同的數據職能。理想情況下清晰的崗位劃分，在真實的業務環境中，可能會存在較大的偏差。因此本文不對數據崗位做進一步拆分，主要就數據分析的這個大類的招聘情況做簡要分析。","attrs":{}}]},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"03|數據分析的市場","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" 鑑於上文對數據分析的現狀說明，下文將詳細展開數據分析的市場情況分析。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":1,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"數據來源：","attrs":{}}]},{"type":"numberedlist","attrs":{"start":1,"normalizeStart":1},"content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":1,"number":1,"align":null,"origin":null},"content":[{"type":"text","text":"本文選擇 ","attrs":{}},{"type":"link","attrs":{"href":"https://www.51job.com","title":"","type":null},"content":[{"type":"text","text":"前程無憂","attrs":{}}]},{"type":"text","text":" 作爲職位需求數據來源，選擇招聘職位信息中包括“數據”，“分析”，“挖掘”，“增長”等字段，選擇截止到2021年11月11日仍舊活躍的招聘信息作爲篩選條件獲得原始數據。","attrs":{}}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":1,"number":2,"align":null,"origin":null},"content":[{"type":"zerowidth","attrs":{}},{"type":"text","text":"對原始數據進行剔重，清洗，過濾後得到的目標分析數據共計9600+，下文內容主要就清洗後的數據展開。","attrs":{}}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":1,"number":3,"align":null,"origin":null},"content":[{"type":"zerowidth","attrs":{}},{"type":"text","text":"因招聘數據中薪資一般以區間的方式呈現，如“5-10萬/月”，“60-80萬/年”等，本文將區間薪資數據拆分並進行平均化處理，最終統一以平均年薪展開。如“5-10萬/月”的平均年薪爲90萬/年。","attrs":{}}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":1,"number":4,"align":null,"origin":null},"content":[{"type":"zerowidth","attrs":{}},{"type":"text","text":"本文統計的薪資爲招聘界面顯示的基本薪資。一般大公司會有獎金激勵+股權激勵等額外福利，實際最終的年總包可能遠超基本薪資年包。","attrs":{}}]}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" ","attrs":{}}]},{"type":"paragraph","attrs":{"indent":1,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"數據結論：","attrs":{}}]},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"從","attrs":{}},{"type":"text","marks":[{"type":"italic","attrs":{}},{"type":"size","attrs":{"size":10}}],"text":"圖1|不同城市職位需求數分佈情況 ","attrs":{}},{"type":"text","text":"可以看出，“北上廣深”作爲老牌的一線城市，確實有着無與倫比的綜合實力和競爭力，整體職位需求數佔全部地域的一半以上。新一線城市如“杭州”，“武漢”，“南京”，“成都”等地域也基本符合我們對其競爭力的認知。","attrs":{}}]}]}],"attrs":{}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/6e/6ec4956f33ec2212790656ffc4178c53.png","alt":null,"title":"","style":[{"key":"width","value":"100%"},{"key":"bordertype","value":"none"}],"href":"","fromPaste":false,"pastePass":false}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"從","attrs":{}},{"type":"text","marks":[{"type":"italic","attrs":{}},{"type":"size","attrs":{"size":10}}],"text":"圖2|職位需求數Top10城市及薪資分佈","attrs":{}},{"type":"text","text":" 可以看出，職位需求數最高的城市是上海，處於第二梯隊的是廣州，深圳，北京。職位需求數據和對應的平均薪資呈現非線性關係。","attrs":{}}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"從","attrs":{}},{"type":"text","marks":[{"type":"italic","attrs":{}},{"type":"size","attrs":{"size":10}}],"text":"圖3|平均薪資Top10城市及職位需求數情況","attrs":{}},{"type":"text","text":" 可以看出，平均薪資最高的城市是北京，處於第二梯隊的是廣州，深圳，杭州，第三梯隊的是無錫，南京，廣州等。","attrs":{}}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"對比各地域的平均年薪和中位數年薪，可以發現二者呈現相關性趨勢。另外平均年薪均大於中位數年薪，可推測存在超大年薪影響的情況，拉高了整體的年薪均值。 ","attrs":{}}]}]}],"attrs":{}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/18/18ab73a28c2598a6669f1c6050886614.png","alt":null,"title":"","style":[{"key":"width","value":"100%"},{"key":"bordertype","value":"none"}],"href":"","fromPaste":false,"pastePass":false}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/d4/d410c8e87428cf8076ee39edca6826ee.png","alt":null,"title":"","style":[{"key":"width","value":"100%"},{"key":"bordertype","value":"none"}],"href":"","fromPaste":false,"pastePass":false}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"從","attrs":{}},{"type":"text","marks":[{"type":"italic","attrs":{}},{"type":"size","attrs":{"size":10}}],"text":"圖4|不同學歷及工作經驗人員的職位需求數分佈 ","attrs":{}},{"type":"text","text":"和 ","attrs":{}},{"type":"text","marks":[{"type":"italic","attrs":{}},{"type":"size","attrs":{"size":10}}],"text":"圖5|不同公司的不同學歷人員需求分佈","attrs":{}},{"type":"text","text":" 可以看出，市場上對學歷的要求仍舊較高，本科及以上學歷要求佔比73%，其中事業單位對學歷要求最高，本科及以上學歷要求佔比100% ，碩士及以上學歷要求佔比68%。以本科學歷需求人員來看，行業經驗同樣重要，1年以上經驗佔比76%。","attrs":{}}]}]}],"attrs":{}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/2c/2c82c220a54a108701f1e55febb50fe7.png","alt":null,"title":"","style":[{"key":"width","value":"100%"},{"key":"bordertype","value":"none"}],"href":"","fromPaste":false,"pastePass":false}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/46/4632ba54994952edf094a3b888e285ee.png","alt":null,"title":"","style":[{"key":"width","value":"100%"},{"key":"bordertype","value":"none"}],"href":"","fromPaste":false,"pastePass":false}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"從","attrs":{}},{"type":"text","marks":[{"type":"italic","attrs":{}},{"type":"size","attrs":{"size":10}}],"text":"圖6|不同類型及規模公司的職位需求數分佈","attrs":{}},{"type":"text","text":" 可以看出，不同類型的公司對數據分析類人才的需求情況不一樣。就最終的需求數而言，民營企業佔比最高，且民營企業中50-500人規模的公司佔比最多。","attrs":{}}]}]}],"attrs":{}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/3c/3c53df968c050ee78d72ecf12f98fef7.png","alt":null,"title":"","style":[{"key":"width","value":"100%"},{"key":"bordertype","value":"none"}],"href":"","fromPaste":false,"pastePass":false}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"取平均薪資大於50w的職位進行分析，一般需要5-7年工作經驗，其大部分來自於民營公司。","attrs":{}}]}]}],"attrs":{}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/34/347ee0d5b02f923a2c6c9381c5c2bfee.png","alt":null,"title":"","style":[{"key":"width","value":"100%"},{"key":"bordertype","value":"none"}],"href":"","fromPaste":false,"pastePass":false}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"04|認知驗證","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" 隨着對數據分析崗位的市場現狀的逐步說明，忽然腦殼中冒出來一個想法，我們一般意義上認爲的地域是薪資的一個重要參考因素是否有統計學的意義，即需要驗證僅地域不一致的情況下，薪資數據是否有顯著性差異。下文主要對該部分的認知的驗證展開。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"基本概念：","attrs":{}},{"type":"link","attrs":{"href":"https://baike.baidu.com/item/%E6%98%BE%E8%91%97%E6%80%A7%E5%B7%AE%E5%BC%82/950812?fr=aladdin","title":"","type":null},"content":[{"type":"text","text":"顯著性差異","attrs":{}}]},{"type":"text","text":"是一個統計學名詞。它是統計學上對數據差異性的評價。通常情況下，只有當實驗結果達到0.05水平或者0.01水平，纔可以說數據之間具備了差異顯著或者極顯著。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"假設命題：在學歷，工作經驗年限等因素一致的情況，不同地域的人員薪資存在差異。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"數據來源：分別取“廣州”和“深圳”兩個非常接近的一線城市的具有相同\"本科\"學歷，“3-4年工作經驗”的招聘數據進行分析。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"分析過程：","attrs":{}}]},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/b1/b17658e77adbf8b42a1da762fc938626.png","alt":null,"title":"","style":[{"key":"width","value":"100%"},{"key":"bordertype","value":"border"}],"href":"","fromPaste":false,"pastePass":false}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"分析結果：","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"從上圖可以發現，針對隨機抽取的238組數據看，其中 F 大於 F crit，且 P-value 大於0.01，小於0.05。說明兩組數據在a=0.05 的水平上，存在顯著差異，即","attrs":{}},{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"不同地域同類型人員的薪資確實會因地域不同而存在差異，即使是廣州和深圳這兩個同是第一梯隊的地域","attrs":{}},{"type":"text","text":"。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"05|工具說明","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"工具版本說明：","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"python 3.9 (編譯環境 Sublime Text3)，excel 2020， mysql 8.0 ","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"文章用時分佈：","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"總用時5天","attrs":{}},{"type":"text","text":"，其中python及mysql環境準備1天，爬蟲準備2天(編程基礎太薄弱), 數據分析及文檔編寫2天。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"參考文章：","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"基於網絡招聘信息的分析與挖掘：","attrs":{}},{"type":"link","attrs":{"href":"https://wenku.baidu.com/view/79f0479d1b37f111f18583d049649b6648d70991.html","title":null,"type":null},"content":[{"type":"text","text":"https://wenku.baidu.com/view/79f0479d1b37f111f18583d049649b6648d70991.html","attrs":{}}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"python安裝參考指導：","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"link","attrs":{"href":"https://www.cnblogs.com/mini-monkey/p/11544259.html","title":null,"type":null},"content":[{"type":"text","text":"https://www.cnblogs.com/mini-monkey/p/11544259.html","attrs":{}}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"Sublime Text3 配置python3 環境","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"link","attrs":{"href":"https://blog.csdn.net/samenmoer/article/details/89740271","title":null,"type":null},"content":[{"type":"text","text":"https://blog.csdn.net/samenmoer/article/details/89740271","attrs":{}}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"python爬蟲：","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"link","attrs":{"href":"https://blog.csdn.net/qq_42006613/article/details/109292929","title":"","type":null},"content":[{"type":"text","text":"https://blog.csdn.net/qq_42006613/article/details/109292929","attrs":{}}]}]}]}