{"id":8314,"date":"2017-03-13T15:00:27","date_gmt":"2017-03-13T06:00:27","guid":{"rendered":"http:\/\/sitest.jp\/blog\/?p=8314"},"modified":"2022-04-13T17:27:42","modified_gmt":"2022-04-13T08:27:42","slug":"%e3%83%93%e3%83%83%e3%82%af%e3%83%87%e3%83%bc%e3%82%bf%e5%88%86%e6%9e%90%e3%81%ab%e5%af%be%e5%bf%9c%e3%81%a7%e3%81%8d%e3%82%8b%e6%a9%9f%e6%a2%b0%e5%ad%a6%e7%bf%92%e3%83%a9%e3%82%a4%e3%83%96%e3%83%a9","status":"publish","type":"post","link":"https:\/\/sitest.jp\/blog\/?p=8314","title":{"rendered":"\u30d3\u30c3\u30af\u30c7\u30fc\u30bf\u5206\u6790\u306b\u5bfe\u5fdc\u3067\u304d\u308b\u6a5f\u68b0\u5b66\u7fd2\u30e9\u30a4\u30d6\u30e9\u30ea Apache Mahout\u3068\u306f\uff1f"},"content":{"rendered":"<p>\u4eca\u56de\u306f\u3001Apache Mahout\u3068\u3044\u3046\u6a5f\u68b0\u5b66\u7fd2\u30e9\u30a4\u30d6\u30e9\u30ea\u306e\u3054\u7d39\u4ecb\u3092\u3057\u305f\u3044\u3068\u601d\u3044\u307e\u3059\u3002<br \/>\n\u6a5f\u68b0\u5b66\u7fd2\u3068\u3057\u3066\u306f\u30af\u30e9\u30b9\u30bf\u30ea\u30f3\u30b0\u3068\u304b\u3001\u30ec\u30b3\u30e1\u30f3\u30c7\u30fc\u30b7\u30e7\u30f3\u3001\u5206\u985e\u306a\u3069\u3092\u3059\u308b\u30e9\u30a4\u30d6\u30e9\u30ea\u306b\u306a\u308a\u307e\u3059\u3002<br \/>\n\u7c21\u5358\u306b\u5c0e\u5165\u304c\u53ef\u80fd\u3067\u3001Hadoop\u306a\u3069\u306e\u5206\u6563\u74b0\u5883\u4e0b\u306b\u3066\u5b9f\u884c\u3067\u304d\u308b\u3053\u3068\u304c\u51fa\u6765\u307e\u3059\u3002<br \/>\n<!--more--><\/p>\n<div class=\"frame_headding\">\n<h3 style=\"text-align: left;\">\u25a0 \u306a\u305c\u3001mahout\uff1f<br \/>\n<\/h3>\n<\/div>\n<p>\u6a5f\u68b0\u5b66\u7fd2\u3068\u3044\u3046\u306e\u306f\u3001\u8a08\u7b97\u306b\u57fa\u3065\u3044\u3066\u7d50\u679c\u3092\u51fa\u3057\u3066\u3044\u304f\u306e\u3067\u3059\u304c\u3001\u305d\u306e\u5bfe\u8c61\u3068\u306a\u308b\u30c7\u30fc\u30bf\u91cf\u304c\u591a\u3051\u308c\u3070\u591a\u3044\u307b\u3069\u3001\u78ba\u5ea6\u306e\u9ad8\u3044\u7d50\u679c\u3092\u51fa\u3057\u3066\u304f\u308c\u307e\u3059\u3002<br \/>\n\u3057\u304b\u3057\u3001\u30c7\u30fc\u30bf\u91cf\u304c\u591a\u3051\u308c\u3070\u591a\u3044\u307b\u3069\u3001\u6307\u6570\u7684\u306b\u8a08\u7b97\u91cf\u304c\u5897\u52a0\u3057\u3066\u3057\u307e\u3044\u307e\u3059\u3002<\/p>\n<p>\u8fd1\u5e74\u3067\u306f\u3001\u3053\u306e\u3088\u3046\u306a\u5927\u91cf\u30c7\u30fc\u30bf\u51e6\u7406\u306e\u30cb\u30fc\u30ba\u306f\u9ad8\u307e\u3063\u3066\u3044\u307e\u3059\u3002<br \/>\n\u7279\u306b\u5927\u91cf\u306e\u30c7\u30fc\u30bf\u3092\u6271\u3046\u30a2\u30c9\u30c6\u30af\u30ce\u30ed\u30b8\u30fc\u306a\u3069\u306eDSP\u30fbRTB\u306a\u3069\u306e\u4ed5\u7d44\u307f\u3092\u652f\u3048\u308b\u305f\u3081\u3001<br \/>\n\u5927\u91cf\u30c7\u30fc\u30bf\u51e6\u7406\u3092\u3053\u306a\u3055\u306a\u3051\u308c\u306a\u306a\u308a\u307e\u305b\u3093\u3002<\/p>\n<p>\u305d\u3053\u3067\u3001\u300cApache Hadoop\u300d\u3068\u3044\u3046\u6280\u8853\u304c\u6ce8\u76ee\u3055\u308c\u3066\u304d\u307e\u3057\u305f\u3002<br \/>\nHadoop\u3068\u306f\u3001\u5927\u91cf\u306e\u30c7\u30fc\u30bf\u3092\u624b\u8efd\u306b\u8907\u6570\u306e\u30de\u30b7\u30f3\u306b\u5206\u6563\u3057\u3066\u51e6\u7406\u3067\u304d\u308b\u30aa\u30fc\u30d7\u30f3\u30bd\u30fc\u30b9\u306e\u30d7\u30e9\u30c3\u30c8\u30d5\u30a9\u30fc\u30e0\u3067\u3059\u3002<\/p>\n<p>Hadoop\u4e0a\u3067\u306f\u3001MapReduce\u3068\u3044\u3046Hadoop\u3067\u51e6\u7406\u3092\u8a18\u8ff0\u3059\u308b\u30d7\u30ed\u30b0\u30e9\u30df\u30f3\u30b0\u30e2\u30c7\u30eb\u306b\u3066\u30d7\u30ed\u30b0\u30e9\u30e0\u3092\u5b9f\u88c5\u3057\u3066\u3044\u304f\u3053\u3068\u306b\u306a\u308a\u307e\u3059\u3002<br \/>\n\u3057\u304b\u3057\u3001MapReduce\u3067\u306e\u5b9f\u88c5\u306f\u3001\u6a5f\u68b0\u5b66\u7fd2\u306e\u30a2\u30eb\u30b4\u30ea\u30ba\u30e0\u3092\u5b9f\u88c5\u3057\u3088\u3046\u3068\u3059\u308b\u3068\u3001\u4e2d\u3005\u5927\u5909\u3067\u958b\u767a\u73fe\u5834\u3067\u306e\u30ea\u30bd\u30fc\u30b9\u3092\u5927\u304d\u304f\u53d6\u3063\u3066\u3057\u307e\u3044\u307e\u3059\u3002<br \/>\n\u305d\u3053\u3067\u3001Hadoop\u306a\u3069\u306e\u5206\u6563\u74b0\u5883\u3067\u52d5\u4f5c\u3059\u308b\u6a5f\u68b0\u5b66\u7fd2\u306e\u30e9\u30a4\u30d6\u30e9\u30ea\u3068\u3057\u3066\u958b\u767a\u3055\u308c\u305f\u306e\u304cmahout\u3067\u3059\u3002<\/p>\n<p><img loading=\"lazy\" src=\"https:\/\/storage.googleapis.com\/sitest-wp\/blog\/wp-content\/uploads\/2017\/02\/1460444860191.gif\" alt=\"1460444860191\" width=\"500\" height=\"450\" class=\"alignnone size-full wp-image-8338\" \/><\/p>\n<blockquote><p>\u5f15\u7528\u5143\uff1a https:\/\/www.gmo.jp\/report\/single\/?art_id=40<\/p><\/blockquote>\n<div class=\"frame_headding\">\n<h3 style=\"text-align: left;\">\u25a0 mahout \u3067\u4f7f\u3048\u308b\u6a5f\u68b0\u5b66\u7fd2\u30a2\u30eb\u30b4\u30ea\u30ba\u30e0<br \/>\n<\/h3>\n<\/div>\n<p>\u4ee5\u4e0b\u306b\u3001Hadoop\u306a\u3069\u306e\u5206\u6563\u74b0\u5883\u4e0b\u306b\u3066\u5229\u7528\u3067\u304d\u308b\u30a2\u30eb\u30b4\u30ea\u30ba\u30e0\u3092\u6319\u3052\u307e\u3059\u3002<\/p>\n<h4>Collaborative Filtering with CLI drivers (\u5354\u8abf\u30d5\u30a3\u30eb\u30bf\u30ea\u30f3\u30b0\u306b\u95a2\u9023\u3059\u308b\u30a2\u30eb\u30b4\u30ea\u30ba\u30e0)<\/h4>\n<p>&nbsp;<br \/>\n&nbsp;  User-Based Collaborative Filtering<br \/>\n&nbsp;  Item-Based Collaborative Filtering<br \/>\n&nbsp;  Matrix Factorization with ALS<br \/>\n&nbsp;  Matrix Factorization with ALS on Implicit Feedback<br \/>\n&nbsp;  Weighted Matrix Factorization, SVD++<\/p>\n<h4>Classification with CLI drivers (\u5206\u985e\u554f\u984c\u306b\u95a2\u9023\u3059\u308b\u30a2\u30eb\u30b4\u30ea\u30ba\u30e0)<\/h4>\n<p>&nbsp;<br \/>\n&nbsp;  Logistic Regression &#8211; trained via SGD<br \/>\n&nbsp;  Naive Bayes \/ Complementary Naive Bayes<br \/>\n&nbsp;  Hidden Markov Models    deprecated<\/p>\n<h4>Clustering with CLI drivers (\u30af\u30e9\u30b9\u30bf\u30ea\u30f3\u30b0\u306b\u95a2\u9023\u3059\u308b\u30a2\u30eb\u30b4\u30ea\u30ba\u30e0)<\/h4>\n<p>&nbsp;<br \/>\n&nbsp;  Canopy Clustering<br \/>\n&nbsp;  k-Means Clustering<br \/>\n&nbsp;  Fuzzy k-Means<br \/>\n&nbsp;  Streaming k-Means<br \/>\n&nbsp;  Spectral Clustering<\/p>\n<h4>Dimensionality Reduction note: most scala-based dimensionality reduction algorithms are available through the Mahout Math-Scala Core Library for all engines (\u69cb\u9020\u62bd\u51fa\uff0c\u6c4e\u5316\u80fd\u529b\u306e\u5411\u4e0a\u306b\u95a2\u3059\u308b\u30a2\u30eb\u30b4\u30ea\u30ba\u30e0)<\/h4>\n<p>&nbsp;<br \/>\n&nbsp; Singular Value Decomposition<br \/>\n&nbsp; Lanczos Algorithm<br \/>\n&nbsp; Stochastic SVD<br \/>\n&nbsp; PCA (via Stochastic SVD)<br \/>\n&nbsp; QR Decomposition<\/p>\n<p>\u3053\u306e\u3088\u3046\u306b\u3001\u57fa\u672c\u7684\u306a\u6a5f\u68b0\u5b66\u7fd2\u306e\u30a2\u30eb\u30b4\u30ea\u30ba\u30e0\u306f\u7528\u610f\u3055\u308c\u3066\u3044\u308b\u306e\u3067\u3001\u5927\u4f53\u306e\u6a5f\u68b0\u5b66\u7fd2\u3092\u5fc5\u8981\u3068\u3059\u308b\u8981\u6c42\u306b\u306f\u5bfe\u5fdc\u3067\u304d\u308b\u3068\u601d\u3044\u307e\u3059\u3002<\/p>\n<p>\u3057\u304b\u3057\u3001\u30a2\u30eb\u30b4\u30ea\u30ba\u306b\u3088\u3063\u3066\u306f\u3001Hadoop\u4e0a\u3067\u306f\u3001\u975e\u63a8\u5968\u3067\u3042\u3063\u305f\u308a\u3001MapReduce\u3067\u306f\u52d5\u4f5c\u3057\u306a\u3044\u5834\u5408\u304c\u3042\u308a\u3001\u4ee5\u4e0b\u306e<\/p>\n<p>https:\/\/mahout.apache.org\/users\/basics\/algorithms.html<\/p>\n<p>\u3067\u306e\u5bfe\u5fdc\u8868\u3092\u78ba\u8a8d\u3057\u3066\u3001Spark\u306a\u3069\u306e\u4ed6\u306e\u5206\u6563\u74b0\u5883\u4e0b\u306b\u3066\u5bfe\u5fdc\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u306e\u3067\u3001\u3054\u6ce8\u610f\u4e0b\u3055\u3044\u3002<\/p>\n<div class=\"frame_headding\">\n<h3 style=\"text-align: left;\">\u25a0\u307e\u3068\u3081<\/h3>\n<\/div>\n<p>\u4eca\u56de\u306fApache Mahout\u3068\u3044\u3046\u6a5f\u68b0\u5b66\u7fd2\u30e9\u30a4\u30d6\u30e9\u30ea\u306e\u3054\u7d39\u4ecb\u3092\u3057\u307e\u3057\u305f\u3002<br \/>\n\u3084\u306f\u308a\u5b9f\u969b\u306b\u5927\u91cf\u306e\u30c7\u30fc\u30bf\u3092\u5206\u6563\u74b0\u5883\u4e0b\u3067\u5206\u6790\u3057\u3066\u307f\u3066\u3001\u51e6\u7406\u901f\u5ea6\u3092\u4f53\u611f\u3059\u308b\u306e\u304c\u4e00\u756a\u3060\u3068\u601d\u3044\u307e\u3059\u306e\u3067\u3001Mahout\u3092\u52d5\u304b\u3057\u3066\u307f\u3066\u3001\u3068\u306b\u304b\u304f\u30c7\u30fc\u30bf\u3092\u5206\u6790\u3057\u3066\u307f\u307e\u3057\u3087\u3046\uff01<\/p>\n<p>\u6b21\u56de\u306f\u3001\u5b9f\u969b\u306eMahout\u3092\u5229\u7528\u3057\u3066\u306e\u5927\u91cf\u306e\u30c7\u30fc\u30bf\u5206\u6790\u306e\u4e8b\u4f8b\u3092\u3054\u7d39\u4ecb\u3057\u305f\u3044\u3068\u601d\u3044\u307e\u3059\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u4eca\u56de\u306f\u3001Apache Mahout\u3068\u3044\u3046\u6a5f\u68b0\u5b66\u7fd2\u30e9\u30a4\u30d6\u30e9\u30ea\u306e\u3054\u7d39\u4ecb\u3092\u3057\u305f\u3044\u3068\u601d\u3044\u307e\u3059\u3002 \u6a5f\u68b0\u5b66\u7fd2\u3068\u3057\u3066\u306f\u30af\u30e9\u30b9\u30bf\u30ea\u30f3\u30b0\u3068\u304b\u3001\u30ec\u30b3\u30e1\u30f3\u30c7\u30fc\u30b7\u30e7\u30f3\u3001\u5206\u985e\u306a\u3069\u3092\u3059\u308b\u30e9\u30a4\u30d6\u30e9\u30ea\u306b\u306a\u308a\u307e\u3059\u3002 \u7c21\u5358\u306b\u5c0e\u5165\u304c\u53ef\u80fd\u3067\u3001Hadoop\u306a\u3069\u306e\u5206\u6563\u74b0\u5883\u4e0b\u306b\u3066\u5b9f\u884c\u3067\u304d\u308b\u3053\u3068\u304c\u51fa\u6765\u307e\u3059\u3002<\/p>\n","protected":false},"author":1,"featured_media":8320,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[27,49],"tags":[],"acf":{"description":"Apache Mahout\u3068\u3044\u3046\u6a5f\u68b0\u5b66\u7fd2\u30e9\u30a4\u30d6\u30e9\u30ea\u306e\u3054\u7d39\u4ecb\u3067\u3059\u3002\u6a5f\u68b0\u5b66\u7fd2\u3068\u3057\u3066\u30af\u30e9\u30b9\u30bf\u30ea\u30f3\u30b0\u30fb\u30ec\u30b3\u30e1\u30f3\u30c7\u30fc\u30b7\u30e7\u30f3\u30fb\u5206\u985e\u306a\u3069\u304c\u3067\u304d\u3001\u7c21\u5358\u306b\u5c0e\u5165\u304c\u53ef\u80fd\u3067\u3001Hadoop\u306a\u3069\u306e\u5206\u6563\u74b0\u5883\u4e0b\u306b\u3066\u5b9f\u884c\u3067\u304d\u308b\u30e9\u30a4\u30d6\u30e9\u30ea\u3067\u3059\u3002","keywords":"Mahout,\u6a5f\u68b0\u5b66\u7fd2,\u30de\u30b7\u30f3\u30e9\u30fc\u30cb\u30f3\u30b0, Hadoop,Spark","ogp_url":"","banner":""},"_links":{"self":[{"href":"https:\/\/sitest.jp\/blog\/wp-json\/wp\/v2\/posts\/8314"}],"collection":[{"href":"https:\/\/sitest.jp\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sitest.jp\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sitest.jp\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/sitest.jp\/blog\/wp-json\/wp\/v2\/comments?post=8314"}],"version-history":[{"count":23,"href":"https:\/\/sitest.jp\/blog\/wp-json\/wp\/v2\/posts\/8314\/revisions"}],"predecessor-version":[{"id":25195,"href":"https:\/\/sitest.jp\/blog\/wp-json\/wp\/v2\/posts\/8314\/revisions\/25195"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sitest.jp\/blog\/wp-json\/wp\/v2\/media\/8320"}],"wp:attachment":[{"href":"https:\/\/sitest.jp\/blog\/wp-json\/wp\/v2\/media?parent=8314"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sitest.jp\/blog\/wp-json\/wp\/v2\/categories?post=8314"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sitest.jp\/blog\/wp-json\/wp\/v2\/tags?post=8314"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}