AWSç°å¢ã§ã®ããŒã¿çµ±å
IaaSïŒãµãŒãã¹ãšããŠã®ã€ã³ãã©ã¹ãã©ã¯ãã£ïŒãœãªã¥ãŒã·ã§ã³ïŒæãæåãªIaaSã¯Amazon Web ServicesïŒAWSïŒïŒã¯ãããŒã¿ã¢ãŒããã¯ãã£ãŒã®ç°¡çŽ åãšã³ã¹ãåæžãæ±ããäŒæ¥ãçµç¹ã®éã§ãŸããŸã人æ°ãéããŠããŸããäŒæ¥ã¯IaaSãå©çšããããšã§ãå¿ èŠãªéã®ã³ã³ãã¥ãŒãã£ã³ã°ãªãœãŒã¹ãããŒã¿ã¹ãã¬ãŒãžããããã¯ãŒã¯ã ãããã¹ããããã€ããŒããè³Œå ¥ã§ããã®ã人æ°ã®çç±ã§ãã
AWSã¯çŸåšäžçã®IaaSåžå Žã®40%ãå ããŠãããããããã»ã¯ã¿ãŒã®äŒæ¥ãçµç¹ã§äœ¿çšãããŠããŸãããAWSãã©ãããã©ãŒã ãžã®ç§»è¡ãåžæããäŒæ¥ã®å€ãããããŒã¿çµ±åããã»ã¹ã®è€éãã管çããæ¹æ³ãèãåºããšãã課é¡ãæ±ããŠããŸããããããé©åãªæ å ±ãšããŒã«ãããã°ã誰ã§ãAWSããŒã¿çµ±åãããžã§ã¯ããéå§ã§ããŸãã
ããã§ã¯ãAWSç°å¢ã§ã®ETLãšããŒã¿çµ±åã®åºç€ã解説ããAWSçµ±åæŠç¥ãçå®ããéã«èæ ®ãã¹ãèŠçŽ ã«ã€ããŠèª¬æããŸãã
AWSãšã¯ïŒ
Amazon Web ServicesïŒAWSïŒã¯2006幎ãSimple Storage ServiceïŒS3ïŒãšElastic Compute CloudïŒEC2ïŒã®2ã€ã®äž»å補åãçºå£²ããŸããããã以æ¥ãAWSã®è£œåã¯ãã®ç¯å²ãæ·±ããæ°ãå¢ããäŒæ¥ã察象ã«IaaSïŒãµãŒãã¹ãšããŠã®ã€ã³ãã©ã¹ãã©ã¯ãã£ïŒãæäŸããããšãå°éãšãã巚倧ã¯ã©ãŠããã©ãããã©ãŒã ã«ãªããŸãããSynergy Research Groupãçºè¡šããå ±åã«ãããšãAWSã¯çŸåšãäžçã®IaaSåžå Žã·ã§ã¢ã®40%ãå ããŠããŸãã
AWSãã©ãããã©ãŒã ã¯ãã»ãã¥ãªãã£ãã¢ããªãã£ã¯ã¹ãéçºããŒã«ãªã©ãå¹ åºã補åãæäŸããŸãããŸãAWSã¯ãã²ãŒã éçºãããŒãã£ã«ãªã¢ãªãã£ãæ©æ¢°åŠç¿ãšãã£ãããå°éçãªãµãŒãã¹ãæäŸããŠããŸãããã®ããã«å€å²ã«ããããã©ãããã©ãŒã ã§ãããããAWSãšã®çµ±åãéžæããäŒæ¥ã¯å¢ãç¶ããŠããŸããå€ãã®äŒæ¥ã«ãšã£ãŠã®åé¡ã¯ããAWSãšçµ±åãããã©ãããã§ã¯ãªããã©ã®ããã«çµ±åããããã§ããAWSçµ±åæŠç¥ãçå®ããããã®ç¬¬äžæ©ã¯ãçµ±åã®ããã»ã¹ãã©ã®ããã«æ©èœããç©äºãé²ããã«ã¯äœãããã°ããã®ããçè§£ããããšã§ãã
AWSã§ã®ETL
äžè¬çãªããŒã¿çµ±åããã»ã¹ã®1ã€ã¯ãELTïŒæœåºãããŒãã倿ïŒã§ãããã®ããã»ã¹ã§ã¯ããœãŒã¹ããããŒã¿ãæœåºããã䜿çšå¯èœãªåœ¢åŒã«èšå®ããããã®åŸã¿ãŒã²ããã®å®å ã«é ä¿¡ãããŸããããŒã¿ãèšå®ãããã®åŠçã¯ããŒã¿å€æããã»ã¹ãšåŒã°ããå®å ã«é ä¿¡ãããããŒã¿ãããã«äœ¿çšã§ããããã«ãããŒã¿ã®ãœãŒãããã£ã«ã¿ãªã³ã°ãéèšããããã³ã°ãã¯ã¬ã³ãžã³ã°ããšã³ãªããã¡ã³ããè¡ãããŸãã
AWSã§ETLãå®è¡ããããã®ããŸããŸãªæŠç¥ãšããŒã«ããããŸããéçºè ã¯äžéšãå®å šã«èªååããããšããæåã§ã®å ¥åãèŠæ±ããããšããããã«ã¯èªåããã»ã¹ãšæåããã»ã¹ãçµã¿åãããããšãå¯èœã§ãã䜿ãããããå®äºãŸã§ã®æéãåçŸæ§ãããã³ç®¡çå¯èœãªããŒã¿ã®è€éãã«ãã£ãŠæ¹æ³ã¯ç°ãªããŸãããã®åŸåãç¹ã«åŒ·ãã®ã¯ãETLã®å€æãã§ãŒãºã§ãã倿ãã§ãŒãºã§ã¯ãããã€ãã®æ¹æ³ãããŒã«ã§é¢åãªæäœæ¥ã«ããã³ãŒãã£ã³ã°ã®ããã»ã¹ãå¿ èŠã§ãã
AWSãšã®çµ±åã«é©ããETLããŒã«ãç¹å®ããéã«ã¯ã次ã®2ç¹ãèæ ®ããããšãéèŠã§ãã
- ETLããŒã«ã«ã¯ããœãŒã¹ããŒã¿ããŒã¹ã® ã¹ããŒããèªã¿åããããŒã¿ãã«ã¿ãã°åããããŒã¿ã倿ããŠAWSããŒã¿ãŠã§ã¢ããŠã¹ã«æå ¥ããããã®ã¯ãšãªãŒãèªåçã«æºåããæ©èœãå¿ èŠã§ãã
- èªååãããETLãžã§ã ãäœæãèšå®ãå®è¡ã§ããããŒã«ã§ãªããã°ãªããŸãããïŒå€ãã®å ŽåãETLããã»ã¹ã¯åäžã®ç¬ç«ããã€ãã³ãã§ã¯ãªããããããã¯éèŠãªç¹ã§ãããããã£ãŠãETLãžã§ããå®è¡ãããã³ã«æåããããçŽããã«æžãããã«ãAWSãšã®ç¶ç¶çãªçµ±åãåå©çšå¯èœãªã³ãŒãã®äœæãå¯èœã«ããETLããŒã«ã䜿çšããããšãéèŠã§ããïŒ
çµ±åããŒã«
ããŒã¿çµ±åãšã¯ãåãªãããŒã¿ããŒã¹ããå¥ã®ããŒã¿ããŒã¹ãžã®ããŒã¿ç§»è¡ãæå³ãããã®ã§ã¯ãããŸãããããŒã¿çµ±åã¯ã¯ãŒã¯ãããŒãåçåããã·ã¹ãã ãšã³ã³ããŒãã³ãéã®éä¿¡ãèšå®ããããã»ã¹ã§ããããŸããçµå±ã®ãšãããããŒã¿ããæå€§ã®äŸ¡å€ãåŒãåºãããšãã§ããã®ã¯ãïŒããŒã¿ã®ç§»è¡ã ãã§ã¯ãªãïŒå æ¬çãªçµ±åããã»ã¹ã§ããããŒã¿çµ±åããŒã«ã䜿çšãããšãããŒã¿ç§»è¡ãžã®å¯Ÿå¿ã ãã§ãªã次ã®ããšãå¯èœã«ãªããŸãã
- è€æ°ã®ã·ã¹ãã ã®ã¯ãŒã¯ãããŒãAWSã«çµ±åãã
- åºç€ãšãªãçµ±åã¯ãŒã¯ãããŒãåå©çšå¯èœã«ããç°¡åã«ã¢ã¯ã»ã¹ã§ããããã«ãã
- ãžã§ãã®ã¹ã±ãžã¥ãŒãªã³ã°ãšãªãŒã±ã¹ãã¬ãŒã·ã§ã³ã容æã«ãã
- ããŒã¿ã®äžè²«æ§ã確ä¿ãã
ã»ãšãã©ã®äŒæ¥ãçµç¹ã«ãšã£ãŠæãå¹ççã§è²»çšå¯Ÿå¹æã®é«ãä»£æ¿ææ®µãšãªãã®ã¯ãå æ¬çãªã¯ã©ãŠãããŒã¹ã®ããŒã¿çµ±åãœãªã¥ãŒã·ã§ã³ã§ãããã®ã¢ãããŒãã¯ãAWSãæ¢åã®ããŒã¿ããŒãããããšã·ãŒã ã¬ã¹ã«çµ±åããã¯ã©ãŠãã¢ããªãã£ã¯ã¹ãããŒã¿ã¯ãªãªãã£ããªã¢ã«ã¿ã€ã ã¹ããªãŒãã³ã°ãªã©ã®è¿œå ã¿ã¹ã¯ã«å¿ èŠãªãã¹ãŠã®ããŒã«ãæäŸããŸãããŸããããããã¹ãŠã®ã¿ã¹ã¯ã¯ãã©ãããã©ãŒã ã«ãã£ãŠç®¡çããããããéçºè ã®äœæ¥ãç°¡çŽ åãããäŒæ¥ã«äŸ¡å€ããããããŸãã
AWSããŒã¿ãŠã§ã¢ããŠã¹ã®ç¹é·
ãããŸã§ã¯AWSãšã®ããŒã¿çµ±åã®åºæ¬ã«ã€ããŠèª¬æããŠããŸããããããããã¯ITç°å¢ã«ãããŠAWSã®éèŠæ§ãéåžžã«é«ãŸã£ãŠããçç±ãæ¢ã£ãŠãããŸããAWSã¯å¹ åºããšã³ã·ã¹ãã ãšå€å²ã«ãããæ©èœãæã£ãŠããããšãããå€ãã®äŒæ¥ãçµç¹ã«ãšã£ãŠé åçãªéžæè¢ãšãªã£ãŠããŸãããã»ãšãã©ã®AWSçµ±åã§éèŠãªã®ã¯å®ç°å¢ã§æçšãªæ©èœã§ããAWSãšã®çµ±åãå€ãã®äŒæ¥ã®æåªå äºé ã§ããçç±ãçè§£ãããããAWSçµ±åã®å©ç¹ã瀺ã2ã€ã®ã·ããªãªã詳ããèŠãŠã¿ãŸãããã
æè»ãªå±éã«ããå¹çã®åäž
å€ãã®äŒæ¥ã¯ãããŒã«ã«ã®ãªã³ãµã€ããµãŒããŒã䜿çšããŠã¯ã©ãŠãå ã®EMR/Redshiftã¯ã©ã¹ã¿ãŒã«ããŒã¿æŽæ°ãé ä¿¡ããŠããŸããæŽæ°ã®æºåãæŽã£ããšãã«ããŒã¿ã確å®ã«é ä¿¡ããããšãç®çã«ããããã®ã¯ã©ã¹ã¿ãŒã¯ç¶ç¶çãªçšŒåãèš±å¯ãããŠãããããã¢ã€ãã«æã«ããšãã«ã®ãŒãæ¶è²»ããã³ã¹ããçºçãããŠããŸãã
å¥ã®ã¢ãããŒãã§ã¯ãå¿ èŠãªãšãã«éãã¯ã©ã¹ã¿ãŒãã¢ã¯ãã£ãã«ãªããŸããããŒã¿çµ±åãã©ãããã©ãŒã ã䜿çšããŠAWSã«æ¥ç¶ãããšãéå§æ©èœãšåæ¢æ©èœãèšå®ããããšã«ãã£ãŠã1ã€ã®ãžã§ãã ãã«å¯Ÿå¿ããããšããæå®ããééã§èªåå®è¡ãããå埩ãžã§ãã管çããããšãå¯èœã§ãããã®ãªã³ããã³ãã€ã³ãã©ã¹ãã©ã¯ãã£ã¯ãå¿ èŠãªãšãã«ã®ã¿ãžã§ããå®è¡ãããæŽæ°ãå®äºãããšäžæ¢ãããããã«ããããæ°åã§å±éã§ããŸãããã®çµæãäŒæ¥ã¯ã¯ã©ã¹ã¿ãŒãå®éã«ã¢ã¯ãã£ãã§ãã£ãæéã«å¯ŸããŠã®ã¿æéãæ¯æããŸãã
æ¥åã®äžæãåé¿ããããã®ãã€ããªããããŒã¿çµ±å
ã¯ã©ãŠããžã®ããŒã¿ç§»è¡ã決å®ããäŒæ¥ãçµç¹ãæ€èšããªããã°ãªããªãã®ã¯ãçµ±åããã»ã¹ãå®äºãããŸã§ã®éçŸåšã®ããŒã¿ãŠã§ã¢ããŠã¹ãã©ã®ããã«ç¶æããããã§ããAWS Redshiftããªã³ãã¬ãã¹ã®ããŒã¿ãŠã§ã¢ããŠã¹ãšçµã¿åãããŠäœ¿çšããããšã§ãéçšãäžæããããšãªããã³ã¹ãã®åæžãšä¿ææ§ã®åäžãå®çŸãããã€ããªããããŒã¿ã¹ãã¬ãŒãžãœãªã¥ãŒã·ã§ã³ãæ§ç¯ã§ããŸãã䜿çšããããŒã¿çµ±åããŒã«ã«ã¯ãAWS Redshiftã䜿çšããŠããŒã¿ãã·ãŒã ã¬ã¹ã«ãäºæž¬å¯èœãã€å®å šãªæ¹æ³ã§ç§»è¡ã§ããããã«ããã³ãã¯ã¿ãŒãæèŒãããŠããå¿ èŠããããŸãã
ã»ãšãã©ã®ã¯ã©ãŠãããŒã¹ã®ãœãªã¥ãŒã·ã§ã³ã«ã¯ãã€ããªããçµ±åæ©èœãåãã£ãŠãããå æ¬çãªããŒã¿çµ±åããŒã«ã«ã¯ãããŒã¿ã®ä¿åå Žæãã©ãã§ããããšããŒã¿ç§»è¡äœæ¥ãå®äºãããããã®ããŸããŸãªã³ãã¯ã¿ãŒãæèŒãããŠããå¿ èŠããããŸãã
è·å Žã§ã®ããŒã¿çµ±åã®äŸ
ãããŸã§ã¯ãAWSãšã®çµ±åããã»ã¹ãšãäŒæ¥ãããŒã¿ã®ç§»è¡ãéžæããçç±ã«ã€ããŠèª¬æããŠããŸããããŸããããŒã¿çµ±åã®ããã»ã¹ããé©åãªããŒã¿çµ±åããŒã«ã䜿çšããããšã§ã·ãŒã ã¬ã¹ãªç§»è¡ãšå¹çåãå®çŸããæ¹æ³ã«ã€ããŠãæ€èšããŸãããã§ã¯ãå®éã«èª²é¡ãæ±ããŠããäŒæ¥ããã¯ãããŒã¿çµ±åããã»ã¹ã¯ã©ã®ããã«èŠããŠããã®ã§ããããã2ã€ã®äºäŸã以äžã«ç€ºããŸãã
AWSãšã®çµ±åã§ã³ã¹ãã75%åæž
ãã«ã¹ã±ã¢äŒæ¥ã®Accolade瀟ã¯ãã¢ã¯ã»ã¹å¯èœãªå€§éã®ããŒã¿ãå©çšããŠãããŒãœãã©ã€ãºããããµãŒãã¹ãé¡§å®¢ã«ææ¡ããæ¥åãåçåããããšèããŠããŸãããããŒã¿ã®å€§éšåã¯ãµã€ãåã®ã¬ã¬ã·ãŒã·ã¹ãã ã«ä¿åãããŠããŸããããããŒã¿ãæå€§éã«æŽ»çšããã«ã¯ãããŒã¿ã®å€æãç§»è¡ãçµ±åãå¿ èŠã§ããããšãAccolade瀟ã¯èªèããŠããŸãããå瀟ãå¿ èŠãšããŠããã®ã¯ãããŒã¿ã¬ã€ã¯ã«ç§»è¡ããŠAWSãšçµ±åããåã«ãããŒã¿ã®ãããã³ã°ã埩å·åããããã¡ã€ã«äœæãå®è¡ã§ããå æ¬çãœãªã¥ãŒã·ã§ã³ã§ããã
ãã¹ãŠã®ããŒã¿ãTalend Big Data Integrationãšé£æºãããããšã§ãAccolade瀟ã¯AWS RedshiftãS3ãããã³EMRã䜿çšããŠå¹çãé«ããæ£è ã®ã±ã¢ãåäžãããããšã«æåããŸãããã¯ã©ãŠãã¢ããªãã£ã¯ã¹ãå å®ãããããŒã¿ã«é©çšããããšã§ãAccoladeç€Ÿã¯æ£è ã®å»çè²»ã幎é5ïœ8%åæžããæ£è ã®å ¥é¢ããã»ã¹ã75%åæžã§ããŸããã
ããŒã¿çµ±åã«ããæè²ãžã®ã¢ã¯ã»ã¹æ¡å€§
ãã³ã·ã«ããã¢å€§åŠã§ã¯ã絊ä»å奚åŠéã®æ¹éã«åºã¥ããŠè³ªã®é«ãæè²ãããå€ãã®åŠçã«æäŸããŠãããåŠçã¯å€é¡ã®åŠè²»ããŒã³ãè² ãããšãªããç ç©¶ã宿ãããããšãã§ããŸãããã®æ¹éã®å®çŸã¯ã30äžäººã®æŽå©è³éäŸäžè ããæããããã¯ãŒã¯ã«é Œã£ãŠããŸãã
倧åŠã¯2ã€ã®èª²é¡ã«çŽé¢ããŸããããŸããè€æ°ã®CMRã·ã¹ãã ããã®ããŒã¿ãäžãæã«çµ±åããå¿ èŠããããŸãããæ¬¡ã«ãã¹ã±ãŒã©ããªãã£ãæè»ãªå±éãªã©ãããããã³ã¹ãåæžçãæŽ»çšããããšèããŸãããããã§ãTalend Cloudã䜿çšããããšã§ãè€æ°ã®ãœãŒã¹ããã®ããŒã¿ãçµ±åããããŒã¿ãã€ãã³ã°ãéããŠåŸæŽè ãšã®é¢ä¿åŒ·åã«ã€ãªããç¥èŠãç²åŸããŸããããã®çµæãèŽäžä»¶æ°ã¯7%å¢å ããåå ¥ã18%å¢å ããŸããã
AWSãšã®çµ±åã«åããŠ
AWSçµ±åæŠç¥ã®èšç»ãšå®è¡ã¯å€§å€ãªäœæ¥ã®ããã«æããŸãããå¿ ãããããã§ã¯ãããŸãããé©åãªçµ±åããŒã«ãšæ å ±ãããã°ã誰ã§ãè¿ éãã€ç¢ºå®ã«çµ±åãããžã§ã¯ããé²ããããšãã§ããŸãã
Talend Cloud Integration Platformã¯ãAWSãšã®ãªã³ãã¬ãã¹/ã¯ã©ãŠã/ãã€ããªããçµ±åã®ç®¡çã«åœ¹ç«ã¡ãŸãã匷åãªã°ã©ãã£ã«ã«ããŒã«ãçµ±åãã³ãã¬ãŒããããã³900ãè¶ ããã³ã³ããŒãã³ããèªç±ã«æŽ»çšã§ãããããçµ±åã®æåã確å®ãªãã®ã«ããŸãã
ä»ããç¡åãã©ã€ã¢ã«çãããŠã³ããŒãããŠãAWSãžã®ç§»è¡ã«å¿ èŠãªãã®ãã¹ãŠãå ¥æããŠãã ããã