スタディサプリを支えるデータ分析基盤～設計の勘所と利活用事例～

•

55 likes•19,446 views

Tetsuo Yamabe

デブサミ2017【17-B-5】の講演資料です。 http://event.shoeisha.jp/devsumi/20170216/session/1291/

Technology

(C) Recruit Marketing Partners Co.,Ltd. All rights reserved.

(C) Recruit Marketing Partners Co.,Ltd. All rights reserved.
• ( https://ring.education/ )
-
- https://ring.education/research/2016_hs_al_experiment_report_02/

(C) Recruit Marketing Partners Co.,Ltd. All rights reserved.
id grade_id gender school_id
AAA 001 female 0000X
BBB 002 male 0000Y
CCC 005 male 0000Z
id label
001
002
003
id label
0000X X
0000Y Y
0000Z Z
id grade gender school
AAA female X
BBB male Y
CCC male Z

(C) Recruit Marketing Partners Co.,Ltd. All rights reserved.
Rails
Kinesis
Lambda
TD SDK
web JS app native
web Single Page Application

(C) Recruit Marketing Partners Co.,Ltd. All rights reserved.
/(^o^)

(C) Recruit Marketing Partners Co.,Ltd. All rights reserved.
embulk-input-mongodb
by @hakobera
embulk-input-postgresql
embulk-parser-json
embulk-filter-expand_json
embulk-filter-hash
by @kamatama41
embulk-filter-mask
by @beniyama
embulk-output-td

(C) Recruit Marketing Partners Co.,Ltd. All rights reserved.
Embulk Hive / Presto

(C) Recruit Marketing Partners Co.,Ltd. All rights reserved.
class DailyVideoRatingReport(luigi_td.Query):
type = 'hive'
database = LuigiConfig().main_db
report_database = LuigiConfig().report_db
source = ‘queries/hive/daily/history/daily_video_rating_report.sql’
jst_date = luigi.DateParameter(default=DateTimeUtil.get_jst_date())
def requires(self):
return [
DailyUserMasterCreate(self.jst_date),
DailyContentsMasterCreate(self.jst_date)
]

$(C) Recruit Marketing Partners Co.,Ltd. All rights reserved. def run(self): TdUtil.drop_partition( table=‘video_rating_report’, to_jst_date=self.jst_date ) super(DailyVideoRatingReport, self).run() def output(self): return luigi_td.ResultTarget( '{0}/DailyVideoRatingReport-{1}.txt'.format( LuigiConfig().output_path, self.jst_date.strftime('%Y-%m-%d') ), 'td://@/reports/video_rating_report?mode=append' )$

$(C) Recruit Marketing Partners Co.,Ltd. All rights reserved. +video_rating_report: +partial_delete: td_partial_delete>: video_rating_report database: reports from: ${moment(session_time).utc().add("days", -1).unix()} to: ${moment(session_time).utc().unix()} +insert_records: td>: queries/reporting/video_rating_report_insert.sql database: reports engine: presto insert_into: video_rating_report$

$(C) Recruit Marketing Partners Co.,Ltd. All rights reserved. +fetch_records: td>: queries/reporting/video_ratings_fetch.sql database: reports engine: presto store_last_results: true +slack_notification: http>: https://hooks.slack.com/services/XXXXXXXX method: POST content: text: “Average rating is ${td.last_results.average_ratings}” link_names: true content_format: json$

(C) Recruit Marketing Partners Co.,Ltd. All rights reserved.
web console

What's hot

ChatGPTは思ったほど賢くない

Carnot Inc.

エンジニアの個人ブランディングと技術組織

Takafumi ONAKA

シリコンバレーのスタートアップを数多く取材する中で気付いた「シリコンバレーにおけるディシプリン（規律）の存在」や「General Electric（GE）やIBM、SAPといった老舗企業が必死になってシリコンバレーのスタートアップを真似している理由」、そして「日本企業がイノベーションを実現するための処方箋」について解説します詳しく知りたい場合は「GE 巨人の復活」をご覧下さい。 http://www.nikkeibp.co.jp/atclpubmkt/book/17/P55110/ 今後の記事は「シリコンバレーNext」をご覧下さい。 http://itpro.nikkeibp.co.jp/siliconvalley/

シリコンバレーの「何が」凄いのか

Atsushi Nakada

Developers Summit 2022の登壇スライドです。 https://event.shoeisha.jp/devsumi/20220217/session/3647/ 俺のプロダクト開発用語辞典 https://www.youtube.com/channel/UCnUdhofhFN2RotPou4a55_w オーバーエンジニアリングとは？ https://www.youtube.com/watch?v=6XQOSj7rutI オーバーエンジニアリングとは（ブログ版） https://i2key.hateblo.jp/entry/2021/12/25/101957

オーバーエンジニアリングって何？ #devsumi #devsumiA

Ore Product

ナレッジグラフ入門

KnowledgeGraph

爆速クエリエンジン”Presto”を使いたくなる話

Kentaro Yoshida

マッチングサービスにおけるKPIの話

cyberagent

ChatGPT 人間のフィードバックから強化学習した対話AI

Shota Imai

2022年5月18日【iCARE Dev Meetup #33】デザイナー目線のユーザーとの向き合い方でのスライドです。ユーザーインタビューをするとき、私たちはつねに「認知バイアス」にさられています。認知バイアスの影響を受けると、私たち自分に都合のよい情報ばかりピックアップしてしまいます。ユーザーにしっかり寄り添ったプロダクトをつくるためには、きちんとバランスのよいユーザーインタビューをする必要があります。本セッションでは、陥りがちな認知バイアスをミニワークを交えて体験し、ユーザーインタビューで気をつけるべきポイントを解説します。なお、今日の登壇を誘ってくださった @murokaco さんが熱心な研究員（BiS というアイドルのファン）なので、 BiS（第3期）のデビュー曲「BiS -どうやらゾンビのおでまし-」をタイトルに入れてプレゼンしています。

ユーザーインタビューするときは、どうやらゾンビのおでましさ

Yoshiki Hayama

ヤフーはAIテックカンパニーを目指し、その実現に向かって進んでいます。そのためには、AI開発のためのデータ基盤が必要です。本セッションでは、AI開発に必要なデータ基盤の全体概要と、開発を効率化するAIプラットフォームを紹介をします。 Yahoo! JAPAN Tech Conference 2022は2022年2月3日、4日に開催しました。 https://techconference.yahoo.co.jp/2022/ アーカイブ動画はこちらからご覧ください。 https://youtu.be/XZKOHIfEnsU

ヤフーのAIプラットフォーム紹介～AIテックカンパニーを支えるデータ基盤～ #yjtc

Yahoo!デベロッパーネットワーク

テスト文字列に「うんこ」と入れるな

Kentaro Matsui

え!? Power BI の画面からデータ更新なんてできるの!? ～PowerApps カスタムビジュアルの可能性～

Yugo Shimizu

リクルートのWebサービスを支える「RAFTEL」

Recruit Technologies

事業の進展とデータマネジメント体制の進歩（＋プレトタイプの話）

Tokoroten Nakayama

リクルートを支える横断データ基盤と機械学習の適用事例

Tetsutaro Watanabe

え！？データがオンプレにあるけどPower BI で BI したいの？

Yugo Shimizu

Python 3.9からの新定番zoneinfoを使いこなそう

Ryuji Tsutsui

各種データベースの特徴とパフォーマンス比較

株式会社オプト　仙台ラボラトリ

JDMC LT#1 - なぜモノタロウでデータマネジメントが必要になったのか

株式会社MonotaRO Tech Team

フロー効率性とリソース効率性、再入門 #devlove #devkan

Itsuki Kuroda

What's hot (20)

ChatGPTは思ったほど賢くない

エンジニアの個人ブランディングと技術組織

シリコンバレーの「何が」凄いのか

オーバーエンジニアリングって何？ #devsumi #devsumiA

ナレッジグラフ入門

爆速クエリエンジン”Presto”を使いたくなる話

マッチングサービスにおけるKPIの話

ChatGPT 人間のフィードバックから強化学習した対話AI

ユーザーインタビューするときは、どうやらゾンビのおでましさ

ヤフーのAIプラットフォーム紹介～AIテックカンパニーを支えるデータ基盤～ #yjtc

テスト文字列に「うんこ」と入れるな

え!? Power BI の画面からデータ更新なんてできるの!? ～PowerApps カスタムビジュアルの可能性～

リクルートのWebサービスを支える「RAFTEL」

事業の進展とデータマネジメント体制の進歩（＋プレトタイプの話）

リクルートを支える横断データ基盤と機械学習の適用事例

え！？データがオンプレにあるけどPower BI で BI したいの？

Python 3.9からの新定番zoneinfoを使いこなそう

各種データベースの特徴とパフォーマンス比較

JDMC LT#1 - なぜモノタロウでデータマネジメントが必要になったのか

フロー効率性とリソース効率性、再入門 #devlove #devkan

Viewers also liked

Deep learning algorithms have benefited greatly from the recent performance gains of GPUs. However, it has been unclear whether GPUs can speed up machine learning algorithms such as generalized linear modeling, random forests, gradient boosting machines, and clustering. H2O.ai, the leading open source AI company, is bringing the best-of-breed data science and machine learning algorithms to GPUs. We introduce H2O4GPU, a fully featured machine learning library that is optimized for GPUs with a robust python API that is drop dead replacement for scikit-learn. We'll demonstrate benchmarks for the most common algorithms relevant to enterprise AI and showcase performance gains as compared to running on CPUs. Jon’s Bio: https://umdphysics.umd.edu/people/faculty/current/item/337-jcm.html Please view the video here:

GPU Accelerated Machine Learning

Sri Ambati

Using H2O AutoML for Kaggle Competitions

Sri Ambati

Intro to Machine Learning for GPUs

Sri Ambati

Recent world #1 Kaggle Grandmaster and Research Data Scientist at H2O.ai, Marios Michailidis, will delve into the competitive edge that Driverless AI brings out of the box. Driverless AI can easily score in the top 5% in popular data science challenges against thousands of participants in a matter of minutes with limited processing power. Apart from the actual predictions, one can use Driverless AI data munging and derived knowledge of the data to build even more powerful models. This webinar discusses how Driverless AI can get competitive scores in popular Kaggle challenges. Also, Marios will explain the concepts of hyper-parameter tuning and stacking and how they help to make stronger predictions. Bio: Former world no.1 Kaggle Grandmaster, Marios Michailidis, is now a Research Data Scientist at H2O.ai. He is finishing his PhD in machine learning at the University College London (UCL) with a focus on ensemble modeling and his previous education entails a B.Sc in Accounting Finance from the University of Macedonia in Greece and an M.Sc. in Risk Management from the University of Southampton. He has gained exposure in marketing and credit sectors in the UK market and has successfully led multiple analytics’ projects based on a wide array of themes. Before H2O.ai, Marios held the position of Senior Personalization Data Scientist at dunnhumby where his main role was to improve existing algorithms, research benefits of advanced machine learning methods, and provide data insights. He created a matrix factorization library in Java along with a demo version of personalized search capability. Prior to dunnhumby, Marios has held positions of importance at iQor, Capita, British Pearl, and Ey-Zein. At a personal level, he is the creator and administrator of KazAnova, a freeware GUI for quick credit scoring and data mining which is made absolutely in Java. In addition, he is also the creator of StackNet Meta-Modelling Framework.

Get Competitive with Driverless AI

Sri Ambati

Abstract: In recent years, the demand for machine learning experts has outpaced the supply, despite the surge of people entering the field. To address this gap, there have been big strides in the development of user-friendly machine learning software that can be used by non-experts. Although H2O and other tools have made it easier for practitioners to train and deploy machine learning models at scale, there is still a fair bit of knowledge and background in data science that is required to produce high-performing machine learning models. Deep Neural Networks in particular, are notoriously difficult for a non-expert to tune properly. In this presentation, we provide an overview of the the field of "Automatic Machine Learning" and introduce the new AutoML functionality in H2O. H2O's AutoML provides an easy-to-use interface which automates the process of training a large, comprehensive selection of candidate models and a stacked ensemble model which, in most cases, will be the top performing model in the AutoML Leaderboard. H2O AutoML is available in all the H2O interfaces including the h2o R package, Python module and the Flow web GUI. We will also provide simple code examples to get you started using AutoML. Erin’s Bio: Erin is a Statistician and Machine Learning Scientist at H2O.ai. She is the main author of H2O Ensemble. Before joining H2O, she was the Principal Data Scientist at Wise.io and Marvin Mobile Security (acquired by Veracode in 2012) and the founder of DataScientific, Inc. Erin received her Ph.D. in Biostatistics with a Designated Emphasis in Computational Science and Engineering from University of California, Berkeley. Her research focuses on ensemble machine learning, learning from imbalanced binary-outcome data, influence curve based variance estimation and statistical computing. She also holds a B.S. and M.A. in Mathematics.

Scalable Automatic Machine Learning in H2O

Sri Ambati

H2O.ai's Driverless AI

Sri Ambati

Googleのインフラ技術から考える理想のDevOps

Etsuji Nakai

AI Development with H2O.ai

Yalçın Yenigün

リクルート式AIの活用法

Recruit Technologies

医療データ解析界隈から見たICLR2017

RIKEN, Medical Sciences Innovation Hub Program (MIH)

ICLR2017読み会 Data Noising as Smoothing in Neural Network Language Models @Dena

Takanori Nakai

言葉のもつ広がりを、モデルの学習に活かそう -one-hot to distribution in language modeling-

Takahiro Kubo

Semi-Supervised Classification with Graph Convolutional Networks @ICLR2017読み会

Eiji Sekiya

ICLR読み会奥村純 20170617

Jun Okumura

[ICLR2017読み会 @ DeNA] ICLR2017紹介

Takeru Miyato

170614 iclr reading-public

Katsuhiko Ishiguro

Q prop

Reiji Hatsugai

Viewers also liked (17)

GPU Accelerated Machine Learning

Using H2O AutoML for Kaggle Competitions

Intro to Machine Learning for GPUs

Get Competitive with Driverless AI

Scalable Automatic Machine Learning in H2O

H2O.ai's Driverless AI

Googleのインフラ技術から考える理想のDevOps

AI Development with H2O.ai

リクルート式AIの活用法

医療データ解析界隈から見たICLR2017

ICLR2017読み会 Data Noising as Smoothing in Neural Network Language Models @Dena

言葉のもつ広がりを、モデルの学習に活かそう -one-hot to distribution in language modeling-

Semi-Supervised Classification with Graph Convolutional Networks @ICLR2017読み会

ICLR読み会奥村純 20170617

[ICLR2017読み会 @ DeNA] ICLR2017紹介

170614 iclr reading-public

Q prop

Similar to スタディサプリを支えるデータ分析基盤～設計の勘所と利活用事例～

Traditional Business Planning theories and tools are not keeping pace with the rate of innovation in the startup world. Many startups are no longer using traditional business plans. Many startups do not formally start with applying Porter's Competitive Strategy or Value Chain. For the many billion dollar startups that have recently been created, none has been reported to use traditional business tools such as the voluminous business plan, value chain, and industry attractiveness analysis. Today's billion dollar startups such as Facebook, GroupOn, AirBnB, and DropBox are mainly using tools of Customer Growth Hacking and in particular, tools of the Lean Startup methodology in combination with Growth Hacking. The presentation above includes a visual summary of the methodology of Customer Growth Hacking as it relates to the Lean Startup Methodology and Growth Hacking. The Lean Startup Methodology and Growth Hacking "intersect" in the area of Innovation Accounting and Marketing Analytics and in particular, "EARRR" metrics of the Customer Growth Honeycomb. Although the Lean Startup Methodology is comprehensive, its focus is on emergent problem solving especially using the Enterprise Engine of a business model engine. In contrast, Growth Hacking focuses on the performance of the Customer Growth Engine especially using the "EAARRR" metrics to facilitate innovation accounting. In practice, billion dollar startups synchronize the performance of the Enterprise Engine and Customer Growth Engine with the performance of the Value Engine of a business model while rapidly and inexpensively discovering as well as solving BUMPs: Big Urgent Market Problems. To conclude, this article presents an overview of the methodology of Customer Growth Hacking which covers emergent problem solving as well as deliberate problem solving. In todays world of high volatility, uncertainty, complexity, and ambiguity, the planning paradigm is shifting away from deliberate problem solving to emergent problem solving. While the tools of traditional business planning are applied and relevant to established businesses with established customers and known products, in the fast moving world of startups, traditional business planning tools are becoming obsolete. If you're thinking of building billion dollar startups, the methodology most likely to let you rapidly and inexpensively achieve your goal is Customer Growth Hacking. Why not start with the phase of Customer Hacking (to achieve problem-solution fit), then proceed to Customer Growth (to achieve product-market fit), and move further to Growth Hacking (to achieve business model fit and scaling)? What do you think?

Customer Growth Hacking for Lean Startups: How Silicon Valley is Creating Bil...

Rod King, Ph.D.

"What's in a name? That which we call a rose By any other name would smell as sweet." William Shakespeare *** What is a business? According to Peter Drucker, the purpose of a business is to acquire and keep customers. However, many concepts and descriptions of a business do not reflect the need or goal of acquiring, keeping, and growing customers. In recent years, the concept of a business especially for startups is being challenged. One of the most popular concepts in recent years is Eric Ries's "Lean Startup." Ries defines a (lean) startup as follows: "A startup is a human institution designed to create a new product or service under conditions of extreme uncertainty." While Ries's concept is powerful in highlighting the temporary and experimental nature of a startup, it does not provide a unifying systems metaphor that comprehensively describes the ASPIRATIONS of startups as well as established businesses. I therefore came up with the concept of a "Customer Growth Factory" to fill this void. There is strong synergy between the concept of a lean startup and that of a Customer Growth Factory. Also, a "Customer Growth Factory" relates to Scott Anthony and David Duncan's "Growth Factory." Further, Ash Maurya's concept of a "Customer Factory" ties in with ideas of a Customer Growth Factory in that one of the goals of a Customer Growth Factory is to produce happier customers. A key advantage of the concept of the Customer Growth Factory is that as a "business system", it can be related to both old and emerging ideas of a business. For rapid description, analysis, prototyping, and design of a a business, a Customer Growth Factory is represented using a business model strip.

Customer Growth Factory: A Better Way to Visualize Lean Startups and Establis...

Rod King, Ph.D.

Competitor Analysis Framework PowerPoint Presentation Slides

SlideTeam

In this session, hear from an AWS customer about how they leveraged Amazon Rekognition deep learning-based image and video analysis to power a data-driven decision system for creative asset production. Learn how this customer was able to leverage the raw data provided by Amazon Rekognition combined with performance data to discover actionable insights. See a demonstration of the solution, and hear about media- and advertising-specific use cases. Learn from the customer's experiences implementing their architecture, the challenges, and the pleasant surprises along the way.

Use Amazon Rekognition to Power Video Creative Asset Production (ADT202) - AW...

Amazon Web Services

Successful Crowdfunding via Kickstarter

Raj Anand

pitch deck presentation template for startups

ssuser7102d2

Recruiter.com is a hiring platform for the world’s largest network of recruiters. Recruiter.com empowers businesses to recruit specialized talent faster with virtual teams of recruiters and AI job-matching technology. The Recruiter.com network of over 25,000 small and independent recruiters utilize an innovative web platform, complete with AI-driven job matching, screening and video interviewing (Summer 2020) to recruit talent faster. Recruiter.com's Recruiters On Demand provides businesses of all sizes access to virtual recruiters specialized by vertical industries to source, engage, and hire talent on an as-needed basis.

Recruiter Investor Presentation September 2020

RedChip Companies, Inc.

Project Appraisal Concepts Methods And Techniques PowerPoint Presentation Sli...

SlideTeam

Angel Funding Made Easy - Shanti Mohan, Founder @LetsVenture

Sanjay Jha

A summer training report

Hitesh Patel

The way C-MAP works is ................

Dave Ricker

AWS STARTUP DAY 2018 I Scaling at Amazon Speed - Best Practices for Recruitin...

AWS Germany

Competitor Analysis Framework PowerPoint Presentation Slides

SlideTeam

Smu mba sem 2 summer 2015 assignments

solved_assignments

Aif360 2018-21 dec-eno_kyam

YamashitaKatsushi

Pitch-Deck-White.pptx

HeryAden1

Professional Overview: Lynn Hunsaker - ClearAction

ClearAction

Computer Database 05.pptx

RonaldRamos967956

Building an efficient Agile team is hard enough. This challenging task takes on epic proportions if the PO and the DevTeam are separated by a traditional contract (i.e. a contracted Devteam). Can a new “Agile” contract help close this gap and support an Agile relationship? Phillipe Cantin tackled this puzzle by analyzing the situation through the lens of Information Asymmetry. This new perspective led to a set of guidelines impacting the backlog and the contract conditions and, also, proposes a way to measure Information Asymmetry in the backlog. Philipe Cantin

Solving The Agile Contract Puzzle

Agile Montréal

Sales

salem alamri - CBP

Similar to スタディサプリを支えるデータ分析基盤～設計の勘所と利活用事例～ (20)

Customer Growth Hacking for Lean Startups: How Silicon Valley is Creating Bil...

Customer Growth Factory: A Better Way to Visualize Lean Startups and Establis...

Competitor Analysis Framework PowerPoint Presentation Slides

Use Amazon Rekognition to Power Video Creative Asset Production (ADT202) - AW...

Successful Crowdfunding via Kickstarter

pitch deck presentation template for startups

Recruiter Investor Presentation September 2020

Project Appraisal Concepts Methods And Techniques PowerPoint Presentation Sli...

Angel Funding Made Easy - Shanti Mohan, Founder @LetsVenture

A summer training report

The way C-MAP works is ................

AWS STARTUP DAY 2018 I Scaling at Amazon Speed - Best Practices for Recruitin...

Competitor Analysis Framework PowerPoint Presentation Slides

Smu mba sem 2 summer 2015 assignments

Aif360 2018-21 dec-eno_kyam

Pitch-Deck-White.pptx

Professional Overview: Lynn Hunsaker - ClearAction

Computer Database 05.pptx

Solving The Agile Contract Puzzle

Sales

More from Tetsuo Yamabe

StudySapuri Data Analytics Platform with Treasure Data

Tetsuo Yamabe

SXSWedu 2016 報告会〜EdTech JAPAN 世界への挑戦セッション紹介（山邉分）

Tetsuo Yamabe

昨年の10月末にリリースされた『GMOプライベートDMP』を題材に、私たちの部署で取り組んできた最新の DevOps 事例を時系列を追ってご紹介します。今回、Hadoop を活用した大規模分散処理システムの構築を行うにあたってDocker や Vagrant、Ansible などのツールを初めて導入したのですが、分散環境特有の問題から単なる調査不足からのミスまで様々な壁に直面してきました。その中で試行錯誤した過程や、結果として今なお進んでいるカイゼン事例について、現場の声を生々しくお伝えします。

『GMOプライベートDMP』の開発にあたって取り組んできた DevOps、更にその反省点と現在進行中のカイゼン事例の紹介

Tetsuo Yamabe

先日リリースされた『GMO プライベート DMP』に蓄積されたビッグデータを解析して広告配信施策に活用すべく、今最も注目されている技術の一つといっても過言ではない Apache Spark (https://spark.apache.org/) をアプリクラウドの上で検証してみました。Apache Spark の概要から性能評価の結果までご紹介いたします。

GMO プライベート DMP でビッグデータ解析をするためにアプリクラウドで Apache Spark の検証をしてみた

Tetsuo Yamabe

GMO プライベート DMP 開発で取り組んできた DevOps と今後の展望

Tetsuo Yamabe

継続的デリバリーと読み解く Web 開発あるあるとその対策

Tetsuo Yamabe

Augmented Reality Go: Extending Traditional Game Play with Interactive Self-L...

Tetsuo Yamabe

Prototyping Augmented Traditional Games: Concept, Design and Case Studies

Tetsuo Yamabe

A System Framework for Decision Support in Ambient Intelligence

Tetsuo Yamabe

EmoPoker

Tetsuo Yamabe

Empowering End-users to Find Point-of-interests with a Public Display

Tetsuo Yamabe

Activity-Based Micro-pricing: Realizing Sustainable Behavior Changes through ...

Tetsuo Yamabe

Design Issues and Empirical Study in Mobility Oriented Service Developmentﰀ

Tetsuo Yamabe

Citron : Context Information Acquisition Framework on Personal Devices

Tetsuo Yamabe

More from Tetsuo Yamabe (14)

StudySapuri Data Analytics Platform with Treasure Data

SXSWedu 2016 報告会〜EdTech JAPAN 世界への挑戦セッション紹介（山邉分）

『GMOプライベートDMP』の開発にあたって取り組んできた DevOps、更にその反省点と現在進行中のカイゼン事例の紹介

GMO プライベート DMP でビッグデータ解析をするためにアプリクラウドで Apache Spark の検証をしてみた

GMO プライベート DMP 開発で取り組んできた DevOps と今後の展望

継続的デリバリーと読み解く Web 開発あるあるとその対策

Augmented Reality Go: Extending Traditional Game Play with Interactive Self-L...

Prototyping Augmented Traditional Games: Concept, Design and Case Studies

A System Framework for Decision Support in Ambient Intelligence

EmoPoker

Empowering End-users to Find Point-of-interests with a Public Display

Activity-Based Micro-pricing: Realizing Sustainable Behavior Changes through ...

Design Issues and Empirical Study in Mobility Oriented Service Developmentﰀ

Citron : Context Information Acquisition Framework on Personal Devices

Recently uploaded

The Good, the Bad and the Governed - Why is governance a dirty word? David O'Neill, Chief Operating Officer - APIContext Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

apidays

This presentation explores the impact of HTML injection attacks on web applications, detailing how attackers exploit vulnerabilities to inject malicious code into web pages. Learn about the potential consequences of such attacks and discover effective mitigation strategies to protect your web applications from HTML injection vulnerabilities. for more information visit https://bostoninstituteofanalytics.org/category/cyber-security-ethical-hacking/

HTML Injection Attacks: Impact and Mitigation Strategies

Boston Institute of Analytics

Scaling API-first – The story of a global engineering organization Ian Reasor, Senior Computer Scientist - Adobe Radu Cotescu, Senior Computer Scientist - Adobe Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

apidays

Partners Life - Insurer Innovation Award 2024

The Digital Insurer

Effective data discovery is crucial for maintaining compliance and mitigating risks in today's rapidly evolving privacy landscape. However, traditional manual approaches often struggle to keep pace with the growing volume and complexity of data. Join us for an insightful webinar where industry leaders from TrustArc and Privya will share their expertise on leveraging AI-powered solutions to revolutionize data discovery. You'll learn how to: - Effortlessly maintain a comprehensive, up-to-date data inventory - Harness code scanning insights to gain complete visibility into data flows leveraging the advantages of code scanning over DB scanning - Simplify compliance by leveraging Privya's integration with TrustArc - Implement proven strategies to mitigate third-party risks Our panel of experts will discuss real-world case studies and share practical strategies for overcoming common data discovery challenges. They'll also explore the latest trends and innovations in AI-driven data management, and how these technologies can help organizations stay ahead of the curve in an ever-changing privacy landscape.

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc

AWS Community Day CPH - Three problems of Terraform

Andrey Devyatkin

A Principled Technologies deployment guide Conclusion Deploying VMware Cloud Foundation 5.1 on next gen Dell PowerEdge servers brings together critical virtualization capabilities and high-performing hardware infrastructure. Relying on our hands-on experience, this deployment guide offers a comprehensive roadmap that can guide your organization through the seamless integration of advanced VMware cloud solutions with the performance and reliability of Dell PowerEdge servers. In addition to the deployment efficiency, the Cloud Foundation 5.1 and PowerEdge solution delivered strong performance while running a MySQL database workload. By leveraging VMware Cloud Foundation 5.1 and PowerEdge servers, you could help your organization embrace cloud computing with confidence, potentially unlocking a new level of agility, scalability, and efficiency in your data center operations.

Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...

Principled Technologies

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

sammart93

Axa Assurance Maroc - Insurer Innovation Award 2024

The Digital Insurer

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

Webinar Recording: https://www.panagenda.com/webinars/why-teams-call-analytics-is-critical-to-your-entire-business Nothing is as frustrating and noticeable as being in an important call and being unable to see or hear the other person. Not surprising then, that issues with Teams calls are among the most common problems users call their helpdesk for. Having in depth insight into everything relevant going on at the user’s device, local network, ISP and Microsoft itself during the call is crucial for good Microsoft Teams Call quality support. To ensure a quick and adequate solution and to ensure your users get the most out of their Microsoft 365. But did you know that ‘bad calls’ are also an excellent indicator of other problems arising? Precisely because it is so noticeable!? Like the canary in the mine, bad calls can be early indicators of problems. Problems that might otherwise not have been noticed for a while but can have a big impact on productivity and satisfaction. Join this session by Christoph Adler to learn how true Microsoft Teams call quality analytics helped other organizations troubleshoot bad calls and identify and fix problems that impacted Teams calls or the use of Microsoft365 in general. See what it can do to keep your users happy and productive! In this session we will cover - Why CQD data alone is not enough to troubleshoot call problems - The importance of attributing call problems to the right call participant - What call quality analytics can do to help you quickly find, fix-, and prevent problems - Why having retrospective detailed insights matters - Real life examples of how others have used Microsoft Teams call quality monitoring to problem shoot problems with their ISP, network, device health and more.

Why Teams call analytics are critical to your entire business

panagenda

This presentations targets students or working professionals. You may know Google for search, YouTube, Android, Chrome, and Gmail, but did you know Google has many developer tools, platforms & APIs? This comprehensive yet still high-level overview outlines the most impactful tools for where to run your code, store & analyze your data. It will also inspire you as to what's possible. This talk is 50 minutes in length.

Powerful Google developer tools for immediate impact! (2023-24 C)

wesley chun

Boost Fertility New Invention Ups Success Rates.pdf

sudhanshuwaghmare1

Imagine a world where information flows as swiftly as thought itself, making decision-making as fluid as the data driving it. Every moment is critical, and the right tools can significantly boost your organization’s performance. The power of real-time data automation through FME can turn this vision into reality. Aimed at professionals eager to leverage real-time data for enhanced decision-making and efficiency, this webinar will cover the essentials of real-time data and its significance. We’ll explore: FME’s role in real-time event processing, from data intake and analysis to transformation and reporting An overview of leveraging streams vs. automations FME’s impact across various industries highlighted by real-life case studies Live demonstrations on setting up FME workflows for real-time data Practical advice on getting started, best practices, and tips for effective implementation Join us to enhance your skills in real-time data automation with FME, and take your operational capabilities to the next level.

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

Safe Software

As privacy and data protection regulations evolve rapidly, organizations operating in multiple jurisdictions face mounting challenges to ensure compliance and safeguard customer data. With state-specific privacy laws coming up in multiple states this year, it is essential to understand what their unique data protection regulations will require clearly. How will data privacy evolve in the US in 2024? How to stay compliant? Our panellists will guide you through the intricacies of these states' specific data privacy laws, clarifying complex legal frameworks and compliance requirements. This webinar will review: - The essential aspects of each state's privacy landscape and the latest updates - Common compliance challenges faced by organizations operating in multiple states and best practices to achieve regulatory adherence - Valuable insights into potential changes to existing regulations and prepare your organization for the evolving landscape

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

TrustArc

Join our latest Connector Corner webinar to discover how UiPath Integration Service revolutionizes API-centric automation in a 'Quote to Cash' process—and how that automation empowers businesses to accelerate revenue generation. A comprehensive demo will explore connecting systems, GenAI, and people, through powerful pre-built connectors designed to speed process cycle times. Speakers: James Dickson, Senior Software Engineer Charlie Greenberg, Host, Product Marketing Manager

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

DianaGray10

The value of a flexible API Management solution for Open Banking Steve Melan, Manager for IT Innovation and Architecture - State's and Saving's Bank of Luxembourg Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The value of a flexible API Management solution for O...

apidays

Top 10 Most Downloaded Games on Play Store in 2024

SynarionITSolutions

Data Cloud, More than a CDP by Matt Robison

Anna Loughnan Colquhoun

presentation ICT roal in 21st century education

jfdjdjcjdnsjd

Recently uploaded (20)

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

HTML Injection Attacks: Impact and Mitigation Strategies

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Partners Life - Insurer Innovation Award 2024

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

AWS Community Day CPH - Three problems of Terraform

Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Axa Assurance Maroc - Insurer Innovation Award 2024

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Why Teams call analytics are critical to your entire business

Powerful Google developer tools for immediate impact! (2023-24 C)

Boost Fertility New Invention Ups Success Rates.pdf

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Apidays New York 2024 - The value of a flexible API Management solution for O...

Top 10 Most Downloaded Games on Play Store in 2024

Data Cloud, More than a CDP by Matt Robison

presentation ICT roal in 21st century education

スタディサプリを支えるデータ分析基盤～設計の勘所と利活用事例～

41. (C) Recruit Marketing Partners Co.,Ltd. All rights reserved. id grade_id gender school_id AAA 001 female 0000X BBB 002 male 0000Y CCC 005 male 0000Z id label 001 002 003 id label 0000X X 0000Y Y 0000Z Z id grade gender school AAA female X BBB male Y CCC male Z

55. (C) Recruit Marketing Partners Co.,Ltd. All rights reserved. embulk-input-mongodb by @hakobera embulk-input-postgresql embulk-parser-json embulk-filter-expand_json embulk-filter-hash by @kamatama41 embulk-filter-mask by @beniyama embulk-output-td

61. (C) Recruit Marketing Partners Co.,Ltd. All rights reserved. class DailyVideoRatingReport(luigi_td.Query): type = 'hive' database = LuigiConfig().main_db report_database = LuigiConfig().report_db source = ‘queries/hive/daily/history/daily_video_rating_report.sql’ jst_date = luigi.DateParameter(default=DateTimeUtil.get_jst_date()) def requires(self): return [ DailyUserMasterCreate(self.jst_date), DailyContentsMasterCreate(self.jst_date) ]

62. (C) Recruit Marketing Partners Co.,Ltd. All rights reserved. def run(self): TdUtil.drop_partition( table=‘video_rating_report’, to_jst_date=self.jst_date ) super(DailyVideoRatingReport, self).run() def output(self): return luigi_td.ResultTarget( '{0}/DailyVideoRatingReport-{1}.txt'.format( LuigiConfig().output_path, self.jst_date.strftime('%Y-%m-%d') ), 'td://@/reports/video_rating_report?mode=append' )

64. (C) Recruit Marketing Partners Co.,Ltd. All rights reserved. +video_rating_report: +partial_delete: td_partial_delete>: video_rating_report database: reports from: ${moment(session_time).utc().add("days", -1).unix()} to: ${moment(session_time).utc().unix()} +insert_records: td>: queries/reporting/video_rating_report_insert.sql database: reports engine: presto insert_into: video_rating_report

65. (C) Recruit Marketing Partners Co.,Ltd. All rights reserved. +fetch_records: td>: queries/reporting/video_ratings_fetch.sql database: reports engine: presto store_last_results: true +slack_notification: http>: https://hooks.slack.com/services/XXXXXXXX method: POST content: text: “Average rating is ${td.last_results.average_ratings}” link_names: true content_format: json

スタディサプリを支えるデータ分析基盤～設計の勘所と利活用事例～

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (17)

Similar to スタディサプリを支えるデータ分析基盤～設計の勘所と利活用事例～

Similar to スタディサプリを支えるデータ分析基盤～設計の勘所と利活用事例～ (20)

More from Tetsuo Yamabe

More from Tetsuo Yamabe (14)

Recently uploaded

Recently uploaded (20)

スタディサプリを支えるデータ分析基盤～設計の勘所と利活用事例～

スタディサプリを支えるデータ分析基盤 ～設計の勘所と利活用事例～

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (17)

Similar to スタディサプリを支えるデータ分析基盤 ～設計の勘所と利活用事例～

Similar to スタディサプリを支えるデータ分析基盤 ～設計の勘所と利活用事例～ (20)

More from Tetsuo Yamabe

More from Tetsuo Yamabe (14)

Recently uploaded

Recently uploaded (20)

スタディサプリを支えるデータ分析基盤 ～設計の勘所と利活用事例～

スタディサプリを支えるデータ分析基盤～設計の勘所と利活用事例～

Similar to スタディサプリを支えるデータ分析基盤～設計の勘所と利活用事例～

Similar to スタディサプリを支えるデータ分析基盤～設計の勘所と利活用事例～ (20)

スタディサプリを支えるデータ分析基盤～設計の勘所と利活用事例～