Submit Search
Upload
分枝限定法でモデル選択の計算量を低減する
•
Download as PPTX, PDF
•
0 likes
•
1,002 views
Joe Suzuki
Follow
2018 行動計量学会
Read less
Read more
Data & Analytics
Report
Share
Report
Share
1 of 19
Download now
Recommended
Rectified factor networks for biclustering of omics data
Rectified factor networks for biclustering of omics data
Y-h Taguchi
CRAN Rパッケージ BNSLの概要
CRAN Rパッケージ BNSLの概要
Joe Suzuki
研究紹介(学生向け)
研究紹介(学生向け)
Joe Suzuki
ma92010id461
ma92010id461
matsushimalab
[DL輪読会]Regularization with stochastic transformations and perturbations for d...
[DL輪読会]Regularization with stochastic transformations and perturbations for d...
Deep Learning JP
RとPythonを比較する
RとPythonを比較する
Joe Suzuki
R集会@統数研
R集会@統数研
Joe Suzuki
E-learning Development of Statistics and in Duex: Practical Approaches and Th...
E-learning Development of Statistics and in Duex: Practical Approaches and Th...
Joe Suzuki
Recommended
Rectified factor networks for biclustering of omics data
Rectified factor networks for biclustering of omics data
Y-h Taguchi
CRAN Rパッケージ BNSLの概要
CRAN Rパッケージ BNSLの概要
Joe Suzuki
研究紹介(学生向け)
研究紹介(学生向け)
Joe Suzuki
ma92010id461
ma92010id461
matsushimalab
[DL輪読会]Regularization with stochastic transformations and perturbations for d...
[DL輪読会]Regularization with stochastic transformations and perturbations for d...
Deep Learning JP
RとPythonを比較する
RとPythonを比較する
Joe Suzuki
R集会@統数研
R集会@統数研
Joe Suzuki
E-learning Development of Statistics and in Duex: Practical Approaches and Th...
E-learning Development of Statistics and in Duex: Practical Approaches and Th...
Joe Suzuki
連続変量を含む条件付相互情報量の推定
連続変量を含む条件付相互情報量の推定
Joe Suzuki
E-learning Design and Development for Data Science in Osaka University
E-learning Design and Development for Data Science in Osaka University
Joe Suzuki
UAI 2017
UAI 2017
Joe Suzuki
AMBN2017 サテライトワークショップ
AMBN2017 サテライトワークショップ
Joe Suzuki
Forest Learning from Data
Forest Learning from Data
Joe Suzuki
A Bayesian Approach to Data Compression
A Bayesian Approach to Data Compression
Joe Suzuki
A Conjecture on Strongly Consistent Learning
A Conjecture on Strongly Consistent Learning
Joe Suzuki
A Generalization of the Chow-Liu Algorithm and its Applications to Artificial...
A Generalization of the Chow-Liu Algorithm and its Applications to Artificial...
Joe Suzuki
A Generalization of Nonparametric Estimation and On-Line Prediction for Stati...
A Generalization of Nonparametric Estimation and On-Line Prediction for Stati...
Joe Suzuki
Bayesian Criteria based on Universal Measures
Bayesian Criteria based on Universal Measures
Joe Suzuki
MDL/Bayesian Criteria based on Universal Coding/Measure
MDL/Bayesian Criteria based on Universal Coding/Measure
Joe Suzuki
The Universal Measure for General Sources and its Application to MDL/Bayesian...
The Universal Measure for General Sources and its Application to MDL/Bayesian...
Joe Suzuki
Universal Prediction without assuming either Discrete or Continuous
Universal Prediction without assuming either Discrete or Continuous
Joe Suzuki
Bayesian network structure estimation based on the Bayesian/MDL criteria when...
Bayesian network structure estimation based on the Bayesian/MDL criteria when...
Joe Suzuki
The Universal Bayesian Chow-Liu Algorithm
The Universal Bayesian Chow-Liu Algorithm
Joe Suzuki
Bayes Independence Test
Bayes Independence Test
Joe Suzuki
Efficietly Learning Bayesian Network Structuresbased on the B&B Strategy: A ...
Efficietly Learning Bayesian Network Structuresbased on the B&B Strategy: A ...
Joe Suzuki
Forest Learning based on the Chow-Liu Algorithm and its Application to Genom...
Forest Learning based on the Chow-Liu Algorithm and its Application to Genom...
Joe Suzuki
2016 7-13
2016 7-13
Joe Suzuki
Structure Learning of Bayesian Networks with p Nodes from n Samples when n<...
Structure Learning of Bayesian Networks with p Nodes from n Samples when n<...
Joe Suzuki
More Related Content
More from Joe Suzuki
連続変量を含む条件付相互情報量の推定
連続変量を含む条件付相互情報量の推定
Joe Suzuki
E-learning Design and Development for Data Science in Osaka University
E-learning Design and Development for Data Science in Osaka University
Joe Suzuki
UAI 2017
UAI 2017
Joe Suzuki
AMBN2017 サテライトワークショップ
AMBN2017 サテライトワークショップ
Joe Suzuki
Forest Learning from Data
Forest Learning from Data
Joe Suzuki
A Bayesian Approach to Data Compression
A Bayesian Approach to Data Compression
Joe Suzuki
A Conjecture on Strongly Consistent Learning
A Conjecture on Strongly Consistent Learning
Joe Suzuki
A Generalization of the Chow-Liu Algorithm and its Applications to Artificial...
A Generalization of the Chow-Liu Algorithm and its Applications to Artificial...
Joe Suzuki
A Generalization of Nonparametric Estimation and On-Line Prediction for Stati...
A Generalization of Nonparametric Estimation and On-Line Prediction for Stati...
Joe Suzuki
Bayesian Criteria based on Universal Measures
Bayesian Criteria based on Universal Measures
Joe Suzuki
MDL/Bayesian Criteria based on Universal Coding/Measure
MDL/Bayesian Criteria based on Universal Coding/Measure
Joe Suzuki
The Universal Measure for General Sources and its Application to MDL/Bayesian...
The Universal Measure for General Sources and its Application to MDL/Bayesian...
Joe Suzuki
Universal Prediction without assuming either Discrete or Continuous
Universal Prediction without assuming either Discrete or Continuous
Joe Suzuki
Bayesian network structure estimation based on the Bayesian/MDL criteria when...
Bayesian network structure estimation based on the Bayesian/MDL criteria when...
Joe Suzuki
The Universal Bayesian Chow-Liu Algorithm
The Universal Bayesian Chow-Liu Algorithm
Joe Suzuki
Bayes Independence Test
Bayes Independence Test
Joe Suzuki
Efficietly Learning Bayesian Network Structuresbased on the B&B Strategy: A ...
Efficietly Learning Bayesian Network Structuresbased on the B&B Strategy: A ...
Joe Suzuki
Forest Learning based on the Chow-Liu Algorithm and its Application to Genom...
Forest Learning based on the Chow-Liu Algorithm and its Application to Genom...
Joe Suzuki
2016 7-13
2016 7-13
Joe Suzuki
Structure Learning of Bayesian Networks with p Nodes from n Samples when n<...
Structure Learning of Bayesian Networks with p Nodes from n Samples when n<...
Joe Suzuki
More from Joe Suzuki
(20)
連続変量を含む条件付相互情報量の推定
連続変量を含む条件付相互情報量の推定
E-learning Design and Development for Data Science in Osaka University
E-learning Design and Development for Data Science in Osaka University
UAI 2017
UAI 2017
AMBN2017 サテライトワークショップ
AMBN2017 サテライトワークショップ
Forest Learning from Data
Forest Learning from Data
A Bayesian Approach to Data Compression
A Bayesian Approach to Data Compression
A Conjecture on Strongly Consistent Learning
A Conjecture on Strongly Consistent Learning
A Generalization of the Chow-Liu Algorithm and its Applications to Artificial...
A Generalization of the Chow-Liu Algorithm and its Applications to Artificial...
A Generalization of Nonparametric Estimation and On-Line Prediction for Stati...
A Generalization of Nonparametric Estimation and On-Line Prediction for Stati...
Bayesian Criteria based on Universal Measures
Bayesian Criteria based on Universal Measures
MDL/Bayesian Criteria based on Universal Coding/Measure
MDL/Bayesian Criteria based on Universal Coding/Measure
The Universal Measure for General Sources and its Application to MDL/Bayesian...
The Universal Measure for General Sources and its Application to MDL/Bayesian...
Universal Prediction without assuming either Discrete or Continuous
Universal Prediction without assuming either Discrete or Continuous
Bayesian network structure estimation based on the Bayesian/MDL criteria when...
Bayesian network structure estimation based on the Bayesian/MDL criteria when...
The Universal Bayesian Chow-Liu Algorithm
The Universal Bayesian Chow-Liu Algorithm
Bayes Independence Test
Bayes Independence Test
Efficietly Learning Bayesian Network Structuresbased on the B&B Strategy: A ...
Efficietly Learning Bayesian Network Structuresbased on the B&B Strategy: A ...
Forest Learning based on the Chow-Liu Algorithm and its Application to Genom...
Forest Learning based on the Chow-Liu Algorithm and its Application to Genom...
2016 7-13
2016 7-13
Structure Learning of Bayesian Networks with p Nodes from n Samples when n<...
Structure Learning of Bayesian Networks with p Nodes from n Samples when n<...
分枝限定法でモデル選択の計算量を低減する
1.
大阪大学 鈴木讓 行動計量学会第46回大会 2018年9月6日 分枝限定法で モデル選択の計算量を低減する
2.
ロードマップ 1. BNの構造学習 2. BNの構造学習の計算を分枝限定法で削減
(既存) 3. Gaussian BNの場合の分枝限定法の適用方法 (提案) 4. 実験 5. 結論と課題
3.
ベイジアンネットワーク (BN) 分布の因数分解を、有向非巡回グラフで表現したもの マルコフ同値
4.
P=3変数の場合、11種類のBN
5.
それぞれに事前確率をかけたものを比較 データから、事後確率最大のBNを見出す
6.
確率のようなもの
7.
条件付きスコアを求める
8.
各構造のスコアを比較する Xが先頭の構造だけで16個 Yが先頭、Zが先頭の場合も比較 各構造の事前確率は、等しいとする
9.
(別の)条件付きスコアを求める
10.
各構造のスコアを(別の方法で)比較する 全部で6個 p変数の場合、pの階乗個の比較 最短経路問題でとける
11.
のすべてを計算しないで、 を計算して、 最適な構造を見出したい 計算量を低減する
12.
動的計画法の適用 (Silander-Myllymaki, 2006)
13.
分枝限定法の適用 (Suzuki, ICML-96) の計算を削除できる 最適な構造が見出される ことは、保証される
14.
事後確率最大でも、情報量基準最小でもよい この条件が成立すると、それ以上深い探索は不要 (Suzuki, ICML-96, UAI-17) ➖(尤度)は、非負
15.
Gaussian BN (今回の検討事項) 多変量正規分布をあらわすBN 依存している 変数の個数 分枝限定法の カットルール の構成 ー(尤度)は、負になりうる
16.
提案するカットルール (残り)すべての変数に依存するとき、 尤度が最大になる
17.
実験1 : 人工データ 分岐限定法を使用しないときとくらべ、 1/20から1/10の計算量1/10から1/5の時間
18.
実験2: 実データ (Hitters,
BeastCancer)
19.
まとめ Gaussian BNの構造学習の計算量の削減 • 計算ノード数で1/10-1/20,
計算時間で1/5-1/10に削減 (変数が20-25程度の場合) • 連続BNで、はじめて分枝限定法を適用 • 一般性があるので、波及効果が大きい 今後の課題 Nを固定したときの計算量がpの多項式になることの証明 (離散BNでは証明が完成してる) (来週からの国際会議で発表)
Download now