Yoko Yamakata, Ph.D.

Photo of Yoko Yamakata

Department of Information and Communication Engineering, The University of Tokyo

7-3-1 Hongo, Bunkyo-ku, Tokyo 112-0003, Japan

1. PERSONNAL INFORMATION:

Tel:        +81 3 5841 6651 (office)            Married, Two Sons

Email:    yamakata@hal.t.u-tokyo.ac.jp

OrcID:    0000-0003-2752-6179

Google Scholar ID: YHCB0QUAAAAJ

 

2. EDUCATION:

PhD in Informatics                                                                                                       2007

Graduate School of Informatics

Kyoto University, Japan

Master of Informatics                                                                                                  2002

Graduate School of Informatics

Kyoto University, Japan

Bachelor of Engineering                                                                                              2000

Faculty of engineering

Kyoto University, Japan

 

3. RESEARCH EXPERIENCE AND ACADEMIC CAREER:

August 2016 – March 2017: Department of Informatics, University of Sussex, UK

Visiting Researcher

October 2015 – to date: Department of Information and Communication Engineering, The University of Tokyo, Japan

JSPS Research Fellow

October 2014 – September 2015: Graduate School of Informatics, Kyoto University, Japan

Program-Specific Associate Professor

October 2011 – September 2014: Graduate School of Informatics, Kyoto University, Japan

Associate Professor

January 2010 – September 2011: Academic Center for Computing and Media Studies, Kyoto University, Japan

Program-Specific Lecturer

October 2007 – January 2010: National Institute of Information and Communications Technology, Japan

Research Expert

April 2005 – September 2007: Academic Center for Computing and Media Studies, Kyoto University, Japan

Researcher

 

4. INSTITUTIONAL RESPONSIBILITIES:

§  October 2015 – to date: Research as a research fellow as a JSPS research fellow at the University of Tokyo, Japan

§  January 2010 – September 2015: Research & Teaching at ACCMS/Dept. of Informatics, Kyoto University, Japan

§  October 2007 – January 2010: Research at NICT, Japan

§  April 2005 – September 2007: Research & Conduct of sponsored projects, including administration at ACCMS, Kyoto University, Japan

§    

5. APPROVED RESEARCH PROJECTS:

§  April 2018 to March 2021: Grant-in-Aid for Scientific Research (C): Leader
 家庭における「ものづくり」の学び・教えを助けるマルチメディアコンテンツの作成支援
Grant ID: 18K11425 | Budget amount: \4,420,000

§  April 2018 to March 2022: Grant-in-Aid for Scientific Research (B): Collaborator
深い学びを支援するための機械学習に基づく授業状況・学習状況の推定と可視化
Grant ID: 18H01063 | Budget amount: \15,340,000

§  April 2018 to March 2019: National Institute of Informatics (NII) Collaboration: Leader
“意味構造解析された和文・英文レシピテキストの分析および整理に基づく英語圏での和文レシピデータの活用基盤構築
Grant ID: 戦略4−6| Budget amount: \1,500,000

§  October 2015 to September 2018: Grant-in-Aid for JSPS Fellows: Leader
人から知識を聞きだす音声対話ロボットのためのWeb情報検索を用いた対話戦略の決定
Grant ID: 15J40163 | Budget amount: \4,420,000

§  April 2017 to March 2018: National Institute of Informatics (NII) Collaboration: Leader
“フロ一グラフ化した料理レシピの手順説明文による日英料理用語辞書の自動構築
Grant ID: 自由26| Budget amount: \1,000,000

§  April 2016 to March 2017: National Institute of Informatics Collaboration: Leader
“Web料理レシピの手順説明文書で使用される中間生成物を表す用語辞書の構築
Grant ID: 戦略4−1| Budget amount: \1,300,000

§  April 2014 to March 2018: Grant-in-Aid for Scientific Research (B): Leader
 “消費者生産型レシピコンテンツの手順・記述から見た多様性の解析手法の提案
Grant 26280039 | Budget amount: \ 17,160,000

§  April 2014 to March 2018: Grant-in-Aid for Scientific Research (B): Collaborator
 “受講ログの獲得と可視化による受講状況の振り返りが容易な学習支援システムの開発
Grant ID: 26282062 | Budget amount: \16,250,000

§  April 2012 to March 2016: Grant-in-Aid for Scientific Research (A): Collaborator
 Understanding Human Activity in Kitchen via Food, Tool, and Action Recognition”
Grant 24240030 | Budget amount: \46,150,000

§  April 2011 to March 2015: Grant-in-Aid for Young Scientists (B): Leader
 Recipe dictation system from verbal illustration of how to cook while cooking”
Grant ID: 23700144 | Budget amount: \ 4,420,000

§  April 2011 to March 2014: Grant-in-Aid for Scientific Research (B): Collaborator
 Development and Practice of Acquisition and Visualization System of Behavior of Lecturers and Students in Lecture Room Videos”
Grant ID: 23300311 | Budget amount: \ 18,070,000

§  April 2011 to March 2014: Grant-in-Aid for Scientific Research (B): Collaborator
 Facilitating Video-based Cooking Communication by Multimedia Technologies”
Grant ID: 23500137 | Budget amount: \ 5,200,000

 

6. SUPERVISION OF JUNIOR RESEARCHERS:

§  Takuya Kadowaki, Master thesis, Graduate school of Informatics, Kyoto University, 2015.

§  Asuka Miyazawa, “Detection of the timing to which it can’t take one’s eyes off work,” Master thesis, Graduate school of Informatics, Kyoto University, 2013.

§  Jin Inoue, “Recipe Guiding System based on Cook’s Grabbing/Releasing Motion,” Master thesis, Graduate school of Informatics, Kyoto University, 2013.

§  Atsushi Hashimoto, “Detecting and Tracking Handled-Objects for Progress Management in Food Preparation,” Doctoral thesis, Graduate school of Informatics, Kyoto University, 2012.

§  Yoshiki Tsuchimoto, “Ingredient Recognition from Load Feature at Cutting Action,” Master thesis, Graduate school of Informatics, Kyoto University, 2010

§  Takuto Yamamoto, “Estimation Cooking Action Based on Positional Information Independent of Design of Kitchen,” Master thesis, Graduate school of Informatics, Kyoto University, 2010

 

7. TEACHING ACTIVITIES:

Teaching at Kyoto University from April 2010 to March 2016

§  Basic Informatics I (Undergraduate)", Introduction of Information science for first year students

§  Informatics Fundamentals & Practice A (Undergraduate)”, Practical training course of basic Information science for first year students

§  Media Information Processing (Undergraduate)”, Basic technique for text, speech, sound, image and video processing for third year students

§  Computer Science Laboratory and Exercise 4 (Undergraduate)”: Practical training of Web application design and implementation for third year students of fac. of Engineering

§   “Advanced Media Information Processing (Graduate)”, Advanced technique for text, speech, sound, image and video processing for master course students

 

8. MEMBERSHIPS IN PANELS, BOARDS, ETC., AND INDIVIDUAL SCIENTIFIC REVIEWING ACTIVITIES:

Memberships in panels:

§  The Vice Chairman of special interest group of “Multimedia on Cooking and Eating Activities, IEICE

Scientific review:

§  Transaction on The Institute of Electronics, Information and Communication Engineers (IEICE)

§  Information Processing Society of Japan Transactions (IPSJ)

§  Journal of The Japanese Society for Artificial Intelligence (JSAI)

§  Journal of Japanese Cognitive Science Society (JCSS)

§  The Society of Instrument and Control Engineers, Journal of Control, Measurement, and System Integration (SICE JCMSI)

§  WebDB Forum

§  International Workshop on Multimedia Assisted Dietary Management (MADiMa)

 

9. ACTIVE MEMBERSHIPS IN SCIENTIFIC SOCIETIES, FELLOWSHIPS IN RENOWNED ACADEMIES:

Member of ACM (Association for Computing Machinery), IEICE (the Institute of Electronics, Information and Communication Engineers), and JSAI (The Japanese Society for Artificial Intelligence)

 

10. ORGANIZATION OF CONFERENCES:

§  IJCAI 2018 Workshop on Multimedia for Cooking and Eating Activities (CEA2018), July 15, 2018. Programming chair

§  The Workshop on Data Engineering meets Intelligent Food and COoking Recipe 2018, PARIS, April 16, 2018. Steering Committee Co-Chair

§  IJCAI 2017 Workshop on Multimedia for Cooking and Eating Activities (CEA2017), August 20, 2017. Programming chair

§  ICME 2016 Workshop on Multimedia for Cooking and Eating Activities (CEA2016), July 15, 2016. Program chair

§  ICME 2015 Workshop on Multimedia for Cooking and Eating Activities (CEA2015), July 3, 2015. Organizing chair

§  ACM UbiComp 2014 Workshop on Smart Technology for Cooking and Eating Activities (CEA2014), September 14, 2014. Organizing chair

§  ACM Multimedia 2013 Workshop on Multimedia for Cooking and Eating Activities (CEA2013), October 21, 2013. Organizing chair

§  ACM Multimedia 2012 Workshop on Multimedia for Cooking and Eating Activities (CEA2012), November 2, 2012. Organizing chair

§  ISM 2011 Workshop on Multimedia for Cooking and Eating Activities (CEA2011), December 6, 2011. Organizing chair

§  ISM 2010 Workshop on Multimedia for Cooking and Eating Activities (CEA2010), December 14, 2010. Organizing chair

§  ACM Multimedia 2009 Workshop on Multimedia for Cooking and Eating Activities (CEA2009), October 23, 2009. Organizing chair

§  International Workshop on Intelligent Media Technology for Communicative Intelligence in Warsaw, Poland, September 13-14, 2004. Organizing Committee

§   

 

11. HONOURS AND AWARDS:

2015-2018

Research Fellowships for Young Researchers from Japan Society for the Promotion of Science (JSPS)

2017

The Best Paper Award on the IJCAI 2017 Workshop on Multimedia for Cooking and Eating Activities (CEA2017), “A Comparison of Cooking Recipe Named Entities between Japanese and English,” Yoko Yamakata, John Carroll, Shinsuke Mori

2015

Recognition of Merit on ICME2015 Workshop on Multimedia for Cooking and Eating Activities (CEA2015), Takuya Kadowaki, Yoko Yamakata, Katsumi Tanaka

2012

The Best Paper Award on the ACM Multimedia 2012 Workshop on Multimedia for Cooking and Eating Activities (CEA2012), “Recognizing Ingredients at Cutting Process by Integrating Multimodal Features,” Atsushi Hashimoto, Jin Inoue, Kazuaki Nakamura, Takuya Funatomi, Mayumi Ueda, Yoko Yamakata, Michihiko Minoh

2003

Incentive Award of the Japanese Society for Artificial Intelligence (JSAI)

 

12. CAREER BREAKS:

§  Maternity leave: 2009-09 to 2010-3 and 2011-4 to 2011-9


MAJOR SCIENTIFIC ACHIEVEMENTS (PAST 5 YEARS):

Yoko Yamakata received Ph.D. degree in Informatics from Kyoto University, Kyoto, Japan in 2006. She was an expert researcher of NICT, Japan from 2006, a lecturer and an associate professor of Kyoto University, Japan from 2010. She currently belongs to the University of Tokyo, Japan as a research fellow of JSPS, Japan and also is a visiting researcher of the University of Sussex, UK. Her research interests include multimedia processing and information processing especially regarding to cooking and eating activities. She has served as Organizing Chair for CEA2009–2014, and Program Chair for CEA2015–2018, Steering Committee Co-Chair of DECOR2018, and Program Committee Members for MADiMa2016–2018. A summary of the achieved results / project follows:

           Text corpus on cooking recipe in both of English and Japanese

Prof. Shinsuke Mori, a professor of Kyoto University, and I have constructed a text corpus of cooking recipe. Since cooking recipe is considered as a procedural text, a recipe is able to be described as a flowgraph, that is formed as a directed acyclic graph (DAG), to represent its semantic structure. 208 Japanese recipes and more than 200 English recipes were already converted to this flowgraph format in manual and the number of the recipes in the corpora is increasing. Also we constructed a system for automatically extracting semantic structure from a recipe based on a machine leaning technique and the recipe corpora. This system is available for academic use and several Japanese research groups use them for various purpose including recipe analysis and recipe search and recommendation tasks.

§  Automatic tagging tool for recipe named entities

§  Flow-graph converter for cooking recipe text

           Smartphone food logging application “FoodLog” (iOS/Android)

A research member of Aizawa Lab, the university of Tokyo, Japan from September 2015 to date.

Aizawa Lab, which the applicant is belong to, have constructed a personal food logging system named “FoodLog”. Foodlog is a smartphone application for iOS/Android. When a user uploads a photo of his/her everyday food, the application automatically detects a region of each food item, recognizes it, and return the calorie for each food item based on the nutrition data. Our laboratory provides the service to anybody and now we obtained more than 4.7 million food records by more than 1000 active users. We also specialized this application for professional athletes as collaboration with Japan Institute of Sports Sciences (JISS) and for diabetic patients as a collaboration with Graduate School of Medicine and Faculty of Medicine, The University of Tokyo.

§  FoodLog on App Store

§  FoodLog on Google Play