Arotautanga Mīhini Tukatuka Raraunga
I tēnei ao matihiko, ko ngā raraunga te pūtake matua mō te whakatau kaupapa, te auahatanga hua, te haumarutanga, me te whai huatanga o te whakahaere. Heoi, he mea nui anake ngā raraunga mēnā ka taea te tukatuka tere, tika, me te whai hua. Koinei te wāhi e tino hira ai te arotautanga miihini tukatuka raraunga—he raupapa rautaki hangarau me te whakahaere hei whakapai ake i te mahi a ngā pūnaha tukatuka raraunga, i runga i te tauine iti me te tauine nui. Ko te arotautanga he mea nui atu i te tere noa i ngā tukanga; ka whakarite hoki i te pono o te pūnaha, te tauine, me te manawanui i te mea kei te piki haere te rahinga me te uaua o ngā raraunga.
1. Te Mārama ki ngā Mīhini Tukatuka Raraunga
Ka taea e te miihini tukatuka raraunga te whakauru i ngā wāhanga maha e mahi tahi ana: he pātengi raraunga (SQL/NoSQL), he paipa ETL/ELT, he pūnaha tukatuka puranga (hei tauira, Spark), he tukatuka rerema (hei tauira, Kafka/Flink), he whare putunga raraunga, he roto raraunga rānei. Me whai whakaaro te arotautanga ki te momo kawenga mahi matua:
1. Tukatuka puranga, e tika ana mō ngā pūrongo o ia rā, ngā whakahiatotanga nui, me te whakangungu tauira ā-wā.
2. Te tukatuka rere/tūturu, mō ngā take pēnei i te kimi tinihanga, te aroturukitanga IoT, ngā taunakitanga inamata rānei.
3. OLTP (Tukatuka Tauwhitinga Ipurangi), e arotahi ana ki ngā tauwhitinga tere me te pumau.
4. Ko te OLAP (Tukatuka Tātari Ipurangi), e arotahi ana ki ngā patai tātari matatini me ngā whakahiatotanga.
Ko te tautuhi i ngā tauira mahi te taahiraa tuatahi i mua i te whiriwhiri i ngā tikanga arotau. Ko te rautaki e mahi ana mō te OLTP, tērā pea kāore e pai mō te OLAP, me te ritenga kē.
2. Te Ine i te Mahi: Te Pūtake o te Arotautanga
Ko te arotakenga pai ka tīmata tonu me te ine. E toru ngā inenga matua e whakamahia whānuitia ana:
– Te whakaroa (te wā whakautu): te tere o te urupare a te pūnaha ki ngā tono.
– Te nui o ngā raraunga, ngā whakawhitiwhitinga rānei mō ia waeine wā.
– Te whai hua o te utu (te whai hua o te utu): te utu mō ia waeine o ngā raraunga kua tukatukahia, mō ia patai rānei.
Hei tāpiritanga, he mea nui kia aroturukihia te whakamahinga o te CPU, te mahara, te whakaurunga/whakaputa kōpae, me te putanga whatunga, nā te mea he maha ngā wā ka puta he aukati i roto i tētahi o ēnei wāhanga. Ki te kore he tirohanga—te takiuru, te ine, te whai—he maha ngā wā ka noho ko te arotautanga hei mahi matapae.
3. Te Arotau i te Taumata Hanga Whare
a. Te Kōwhiri i te Tauira Tukatuka Tika
He maha ngā whakahaere e moumou moni ana mā te akiaki i te tukatuka wā-tūturu mō ngā mea katoa, i te wā e taea ai te whakatutuki i te nuinga o ngā hiahia mā te tukatuka puranga. Ko te ture matua: whakamahia te wā-tūturu anake ina tino hiahia te uara pakihi ki te whakautu wawe. Mā tēnei ka māmā ake te tukanga, ā, ka noho tonu ngā utu i raro i te mana whakahaere.
b. Te Tauine Whakapae me te Poutū
Ko te arotautanga he maha ngā wā ka uru ki te whiriwhiri i waenga i:
– Te tauine poutū: te whakanui ake i te kaha tūmau (CPU/RAM).
– Te tauine whakapae: te whakanui ake i te maha o ngā pūnga/mīhini.
Mō ngā pūnaha tukatuka raraunga o ēnei rā, he ngāwari ake te tauine whakapae, engari me whai hoahoa e tautoko ana i te tohatoha raraunga, te wehewehe, me te manawanui hapa.
c. Te wehewehe i ngā kawenga OLTP me OLAP
Mā te whakakotahi i ngā mahi tauwhitinga me ngā mahi tātari i runga i te pūnaha kotahi ka puta he taupatupatu: ka taea e ngā uiui tātari taumaha te whakararuraru i ngā tauwhitinga o ia rā. He maha ngā kamupene e wehewehe ana i ngā mea e rua mā te tāruarua raraunga, mā te whakamahi rānei i tētahi whare putunga raraunga tātari motuhake.
4. Te Arotau i te Rokiroki me te Hanganga Raraunga
a. Ngā Wehewehenga me te Wehewehenga
Mā te wehewehe raraunga mā te wā (ia rā/ia marama) mā ngā kī motuhake rānei ka tere ake te rapu, ka whakaiti i te matawai raraunga, ka māmā ake hoki te whakahaere. I te tauine, mā te wehewehe ka taea te hora i ngā raraunga puta noa i ngā pūnga maha, ā, ka tohatoha i te kawenga.
b. Te Tāurangi Tika
Ka tere ake ngā patai mā te whakamahi i ngā taupū, engari ki te nui rawa ka taea te whakaroa i ngā mahi tuhi (whakauru/whakahou) me te whakanui ake i te whakamahinga rokiroki. Ko te mea nui ko te whiriwhiri i ngā taupū i runga i ngā patai tino auau me ngā patai tino nui. Me arotake te taupū i ia wā, i ia wā, nā te mea ka rerekē pea ngā tauira urunga raraunga.
c. Hōputu Raraunga Whai Hua
I roto i ngā roto raraunga/whare putunga, he pai ake te whakamahi i ngā whakatakotoranga poutū pēnei i te Parquet, ORC rānei mō ngā tātaritanga i te CSV mata, i te JSON rānei. Ka tautokohia e ngā whakatakotoranga poutū te kōpeketanga me te tapahi poutū whiriwhiri, ā, ka tere ake, ka iti ake te utu o ngā uiuinga.
5. Te Arotautanga o te Paipa ETL/ELT
a. Te Whakaiti i ngā Huringa Kāore e Hiahiatia
He maha ngā wā ka puhoi haere ngā paipa nā te mea kāore e tika ana ngā panonitanga paparanga. Me arotake ngā panonitanga: kei te whakamahia ngā pou katoa? He tika te whakataurite/te tango whakataurite? He tukatuka kei reira ka taea te neke ki te wāhanga patai?
b. Tukatuka Whakarara
Hei tere ake i te tukatuka, ka taea te wehewehe i ngā raraunga kia maha ngā wāhanga, ā, ka tukatukahia kia whakarara. Heoi anō, me taurite te whakarara me te kaha o te taupū—nā te nui rawa o ngā mahi ka raru pea te whakaritenga, ka raru rānei te I/O.
c. Utaina Whakapiki
Engari i te tukatuka anō i ngā raraunga katoa i ia rā, whakamahia he huarahi ā-whakatipu, arā, ko ngā raraunga hou, kua whakarerekētia rānei anake te tukatuka (CDC—Change Data Capture). Ka tino whakapai ake tēnei tikanga i te whai huatanga i te tipu haere o ngā rahinga raraunga.
6. Arotautanga Uiui: Penapena Wā me te Utu
Mō ngā pūnaha e hangai ana ki te SQL, mō ngā miihini patai tātari rānei, he mea nui te arotau patai. Ētahi mahi nui:
1. Kaua e whakamahi i te SELECT \, me tiki noa i ngā pou e hiahiatia ana.
2. Tātarihia i mua, whakamahia te WHERE i mua i ngā whakahiatotanga nui.
3. Whakamahia ngā hononga me te whakaaro nui, kia tino tohua, kia wehewehea rānei ngā pou hononga.
4. Kia tūpato ki te kātene, mā te hono i ngā ripanga nui e rua me te kore he tātari ka puta he pahūtanga raraunga.
5. Whakamahia ngā tirohanga kua whakarārangitia, te pupuri rānei, inā koa mō te uiui i te pūrongo kotahi i ngā wā katoa.
Hei tāpiritanga, mā te pānui i te mahere uiui (mahere whakahaere) ka āwhina i te tautuhi i ngā wāhanga tino utu nui—ahakoa he matawai katoa, he momo nui, he hononga hash hiakai mahara rānei.
7. Tukatuka Rere: Te Pūmautanga me te Tere
I roto i te tukatuka wā-tūturu, ko ngā wero matua ko te whakaroa me te tika o te tukatuka. Ko ngā arotautanga ko:
– Ngā tautuhinga rahi puranga moroiti ina whakamahia ana ētahi tauira.
– Te whakahāngai i ngā tawhā pēnei i ngā arai, te whakarara, me te arowhai.
– Te tukatuka kia kotahi te iti rawa, kia kotahi tonu rānei, whiriwhiria te taumata o te ōritetanga e ai ki ō hiahia.
– Te whakahaere pēhanga whakamuri, kia kore ai te pūnaha e hinga ina piki ohorere ngā raraunga e tae mai ana.
Ko te roma pai me whai hoahoa e ātete ana ki ngā pikinga, ngā hapa, me ngā raraunga ka tae mai i te wā tōmuri.
8. Te Whakahaere Rauemi me te Utu
Kāore e oti te arotautanga me te kore he whakahaere utu. Ko ētahi rautaki noa:
– Te whakaōrite-aunoa: te whakanui/te whakaiti i te kaha e ai ki te kawenga.
– Te whakarite i ngā mahi taumaha: te whakahaere i ngā mahi taumaha i ngā hāora ehara i te wā tino pukumahi.
– Ngā tauira kimi/whakakore i mua i ngā mahi e ātete ana ki te taupatupatu.
– Te whakahaere i te huringa ora o ngā raraunga: ka nukuhia ngā raraunga tawhito ki te rokiroki iti ake te utu, mā te whakamahi i te whakarōpūtanga me te pupuri.
Mā te whakahaere tika i ngā utu, ka taea e ngā whakahaere te whakapai ake i te mahi me te kore e tino whakapiki i te tahua.
9. Te Pono, te Aroturuki, me te Whakapai Tonu
Ehara te arotautanga i te kaupapa kotahi-wā. I te tipu haere o ngā raraunga, me ngā hiahia kia rerekē, me aroturuki me te whakarerekē i ngā pūnaha. Ko ngā mahi matua ko:
– Te aroturukitanga mai i te tīmatanga ki te mutunga: mai i te horomitanga, te whakawhiti, ki te whakamahinga raraunga.
– Whakatūpato e hangai ana ki te SLO (Whāinga Taumata Ratonga): hei tauira, he whakaroa mōrahi mō te paipa o te 10 meneti.
– Ngā arowhai kounga raraunga: te whakamana kaupapa, te tāruarua, ngā uara rerekē, me te ōritetanga.
– Te tirotiro i muri i te matenga: te kimi i te pūtake o ngā aituā me te ārai i te hokinga mai anō.
He rite tonu te hiranga o te pono me te kounga o ngā raraunga ki te tere, nā te mea ka taea e ngā raraunga tere engari he hē te arahi ki ngā whakatau hē.
Whakamutunga
Ko te arotau i tētahi mīhini tukatuka raraunga he whakakotahitanga o te mārama ki te kawenga mahi, te rahi tika, te hoahoa hoahoa tika, me te whakatikatika taipitopito o te rokiroki, ngā paipa, me ngā patai. Ehara i te mea ko te whakateretere noa i te tukatuka, engari ko te waihanga i tētahi pūnaha ka taea te whakawhanui, te whai hua i te utu, te pono, me te kaha ki te whakaputa mōhiohio i te wā tika. Ko ngā whakahaere e tino arotau ana i ā rātou mīhini tukatuka raraunga ka pai ake te rite mō te tipu raraunga, ka whakateretere i te auahatanga, ā, ka whakapiki ake i te whakataetae i roto i tētahi taiao e whakahaerehia ana e te mōhiohio.
Ki te hiahia koe, ka taea e au te whakarite i tēnei tuhinga ki tētahi horopaki motuhake (hei tauira, te hokohoko, te peeke, ngā kamupene IoT rānei), ka taea rānei te tāpiri i ngā tauira hangarau motuhake (Spark, Flink, BigQuery, Snowflake, PostgreSQL, me ētahi atu).
