Blog posts

2021

NodePiece - Tokenizing Knowledge Graphs

less than 1 minute read

Published:

A new blogpost on our recent research idea: if nodes in a graph are “words”, can we design a fixed-size vocab of “sub-word” units and go beyond shallow embedding? We propose NodePiece, a compositional tokenization approach for dramatic KG vocabulary size reduction, and find that in some tasks, you don’t even need trainable node embeddings! Furthermore, NodePiece is inductive by design and can encode unseen nodes using the same backbone vocabulary.

Knowledge Graphs @ ICLR 2021

less than 1 minute read

Published:

I compiled a short overview of cool KG-related papers on Neural Reasoning, Temporal Reasoning, Relational Learning, and a bit of Complex QA! Brew some Hot beverage and have a nice weekend reading.

2020

Machine Learning on Knowledge Graphs @ NeurIPS 2020

less than 1 minute read

Published:

Concluding the year with the review of KG-related papers from NeurIPS 2020: Query Embedding, NAS, Meta-Learning, 📦 vs 🔮, big new benchmarks incl. OGB and GraphGYM, and ⚡️ KeOps!

Knowledge Graphs & NLP @ EMNLP 2020

less than 1 minute read

Published:

My review of most prominent KG-related papers from EMNLP 2020. This time we talk about KG-augmented language models, information extraction, entity linking, KG representation algorithms, and many more!

Knowledge Graphs in Natural Language Processing @ ACL 2020

less than 1 minute read

Published:

The anniversary post is the series of KG-related papers. It’s been one year since I started publising such digests, and we’re back to the NLP roots and ACL 2020! This time I focus on question answering, KG embeddings, graph-to-text NLG, some ConvAI and OpenIE.

Knowledge Graphs @ ICLR 2020

less than 1 minute read

Published:

Published a review of KG-related papers from the past ICLR 2020! Among other things we’ll review what’s happening in complex QA, KG embeddings and entity matching with graph embeddings.

Knowledge Graphs @ AAAI 2020

less than 1 minute read

Published:

Here is a fresh digest of KG-related papers in the NLP context from the past AAAI 2020! We’ll check out new stuff in KG-augmented Language Models, GNN-based entity matching, news on link prediction especially in the temporal dimension, and finally some new papers in ConvAI and Knowledge Graph Question Answering!

2019

Machine Learning on Graphs @ NeurIPS 2019

less than 1 minute read

Published:

A new review on Medium of KG and NLP-related papers from NeurIPS 2019. We’ll have a look on novelties in hyperbolic graph embeddings, new KG embeddings with some logic support, new trends in Markov Logic Nets, new goodies from the ConvAI part, and some interesting GNN-related publications. My review of knowledge graph-related papers from EMNLP 2019.

Knowledge Graphs & NLP @ EMNLP 2019

less than 1 minute read

Published:

My review of knowledge graph-related papers from EMNLP 2019. Part I is about language models, extracting KGs from text, dialogue systems, and KG embeddings. Part II discusses question answering, natural language generation from KGs, commonsense reasoning, and NER & RL.

Knowledge graphs in Natural Language Processing @ ACL 2019

18 minute read

Published:

Hello, ACL 2019 has just finished and I attended the whole week of the conference talks, tutorials, and workshops in beautiful Florence! In this post I would like to recap how knowledge graphs slowly but firmly integrate into the NLP community :wink:

Impressions from CISS 2

8 minute read

Published:

Recently returned back from the 2nd Conversational Intelligence Summer School organized by the Text Machine Lab of UMass Lowell and iPavlov lab from MIPT, Moscow. The School took place in Lowell, MA, USA, one of the first US industrial cities with remaining spirit of the industrial revolution. attendees