How-To: Maps Of The Worlds Digital Knowledge

Digital Knowledge

If we could join the dots between all the research articles that have been published digitally, what would happen?

Academics have already suggested that if we could only make the right connections between all the pieces of digital knowledge already available, we could tackle the most pressing questions facing society.

It is not about generating more and more content. It is about connecting the dots between pieces of material already in existence. The problem is not having digital knowledge “somewhere”. Our problem is retrieving knowledge when we need it.

Examples are already available of experts identifying key information about diseases like Alzheimer’s by data mining relevant literature. [1]

Stop talking! Let’s start putting Big Data and Text Mining into practice

You’ve already come across the buzzwords ‘big data’ and ‘text mining,’ right? But do you have this technology on your desktop ready to use? I bet not. At least, only a few of us will.

We can change that. I’ve started to produce an application which brings text mining, indexing and cognitive clustering right to your fingertips. I’ve kept it simple. Its “Google-like” interface with cognitive technologies can analyze private and deep-web content sources.

The technology is just one side of the story. The other side is the ability to analyze personal, private knowledge sources as well as external content libraries.

We need access to an entire body of knowledge, across all content sources

Nowadays, we want easy access to an entire body of domain knowledge stored digitally. Unfortunately, external publishers’ collections represent knowledge silos, because nobody wants to blend together different publishers.

So let’s move forward and join the dots.

The goal is to solve the following two problems:

A. Unify the search experience to different content sources

The good news is that many publishers nowadays offer open access to their content via APIs interfaces. The bad news is that they all look different.

I want to unify these different technical API access points. This will bring all content into one simplified search front-end to enable a search for term-based knowledge domains. Be it Patents, Open Access Science, IEEE or TEDTalks or …

Together with private knowledge sources from different storage locations, this would create a cool search experience.

B. Provide cognitive guided visual maps to explore the results

Often, so much content is returned in response to generic search terms that we ending up having to browse endless listings. But browsing linear listings is not a way of learning our brain can manage efficiently. Confronting hit after hit in a list—when lists don’t end—is not the way our brain works best. Our brain works more associatively. We need different forms to visualize the search result listings.

Forget about boring search result listings – use KnowledgeMaps

What would you think of a search result visualization tool that provides essential information about the structure of topics within the search results? Let’s call it a “KnowledgeMap” of similar terms in the documents from your initial search.

And it does so in a visual way like how our brain works – not with pure “listings.”

It looks like this: A clustering algorithm scans internal relations and linguistic patterns among documents according to how similar they are to the initial search request. Then it presents you with a visual map of these clusters and documents. You can now unearth new groups or cross-document relationships, which might guide you to new, interesting areas that build upon the initial search request.

Example 1: TED Talks – Predictions and future projections

The following infographic-like knowledge map was created by searching TED Talks for future projections and predictions. This allows you to browse 500 TED Talk predictions in clusters like “Future Energy,” “Social Change,” “Education,” or “Medical Research”:

TED Talks

Picture 1: KnowledgeMap of Clusters for TED Talks Predictions [2]

  • The Technology cluster includes a talk by Nicholas Negroponte, “5 predictions, from 1984.”
  • The Social Change cluster ranks the talk “The future of money” about how crytopcurrencies will change the banking landscape as #1.
  • The Politics cluster contains the top ranked talk “A prediction for the future of Iran,” which is based on a mathematical analysis for predicting human events.

These clusters have been auto-generated based on cognitive analysis and each talk is listed in the Noggle KnowledgeMap browser with a link to the original TED website.

Isn’t it a beautiful map of 500 predictions from the world’s most inspiring leaders?

Example 2: How drones are changing our lives

While there is a lot of “social noise” on the “airborne fulfillment centers” patent from Amazon [3], there is not just this one patent in that area. But it will hard to get it by just scrolling large listings in patent databases.

The following infographic-like knowledge map was created by searching the US patent library for “UAV and drone” with additional cognitive clustering based on the search result, which contained over 350 patents.

The KnowledgeMap spotted a cluster with 20 patents on the subject of “delivery” via drones!

Picture 2: KnowledgeMap of Clusters of US Patents on UAVs and Drones [4]

You can now unearth new groups or cross-document relationships, which may guide you to new, interesting areas that build upon the initial search request.

In milliseconds, thousands of documents located for the initial request are analyzed to build cognitive guided clusters. In addition, a new visual search experience is created by using KnowledgeMaps to present and browse the retrieved documents.

Generate stunning knowledge maps on your own

Now the fast and final part of the story: Let’s connect the unified search to access different content sources with the stunning KnowledgeMap feature: There it is, right at your fingertips… Generate stunning maps of the world’s digital knowledge by yourself.

Whether it’s patents, inspiring TED Talks, or open-access science articles—it is all now in front of you. Now you can discover links that could help us tackle whatever question or issue you can think of, in whatever area you choose.

Final 4 How-To steps to do it on your own

1.    Browse available KnowledgeMaps at

2.    Download and install the free application via

3.    Create or select libraries to execute a research request

4.    Generate cognitive clusters and maps on your own

The creative potential of this technology offers new ways of research and digital knowledge discovery. The produced maps are open to share, so it allows the retrieved KnowledgeMaps to be published and shared in your teams.

Now, share the news and lets start to make the right connections between all the pieces of information to tackle the most pressing questions facing society!

Happy Knowledge Mapping!

Yours, Lars von Thienen

Explore ideas in the managed TED Talks library

Terms of Usage

The TED organization encourages to share TED Talks that are licensed for distribution under our Creative Commons license, Attribution–Non Commercial–No Derivatives (or the CC BY – NC – ND 4.0 International). Therefore we provide and share the managed TED library under the same  Creative Commons (CC) license.

The usage of the TED library is free of charge within the free, public available Noggle client. We do not remix or modify the TED content in any form.  We do not provide direct access, host or embedd TED talks in the Noggle application or on our website. The Noggle Library just allows to search and find links to the original talks hosted on the website. The library only provides links to TED talks which are published on the public available website.

The main source used for our library is the public available listing of TED talks in the public google spreadsheet available at the following link: public GoogleDocs TEDTalks spreadsheet

We attribute TED as the owner of the TED Talk in each search result listing when using the managed library and include a link to the talk on the original website. The purpose of the managed TED library is to support the vision of TED and to share ideas and make them easily retrievable with direct forwarding to the orignial content on

How to use the managed TEDTalks library?

This tutorial shows how to use the managed TEDTalks library. The integrated managed TEDTalks library can scan the TEDTalks via the noggle client. Furthermore, you can use all integrated cognitive recommendation features to link public TEDTalks with your individual, personal documents.

Step 1: Select the managed TEDTalks Library

Open the library panel, switch to managed libraries and select the TEDTalks library:

Managed TEDTalks Library

Managed TEDTalks Library




Step 2: Search for specific TED Talks

Now your are able to specifiy search querries to browse and search the TED Talks library from within your client. With a click on the ” Intelligent Open ” button, you will directly forwarded to the page with the respective video talk.



Step 3: Cluster the search results and build cognitive curated playlists via our KnowledgeMap

Noggle can create and cluster all found TED Talks for the subject with the integrated KnowledgeMap feature. By using the integrated cognitive AI processing engine, you can use and browse automatically generated knowledge maps to research and browse the search results.




Step 5: Use the cognitive “Recommender Button” to show related content

If you have found an interesting TED Talk, you can use the “Recommend” button and Noggle will instantly search and present a list with all TED Talks that are related to the selected one. This cognitive retrieval feature also works across different libraries. You can, for example, select different libraries with the Library Manager panel. When you press the “Recommend” button, noggle will also search for related documents from all current selected libraries. This way, you can use public TED talks to retrieve personal documents that are related with a presentation. Or the other way: You can search documents, activate the TED library within the Library Manager panel, and press the “Recommend” button on your document. This way, Noggle will pull up TED talks that are related to your personal document.


What would a robot see in TED Talks? …beautiful TED Talk maps

What would happen if we fed a robot with all the TED talks from the most inspiring leaders in the world over the last 10 years and asked key questions of the robot afterwards? Review beautiful TED Talk maps generated by the Noggle knowledge assistant.

Would the robot answer similarly to how we as humans would? Is current machine-learning and cognitive artificial intelligence able to learn and teach a “dump” robot about our world? No theoretical talk about the future of AI—let’s see what we can get out of this technology today.

So I took the publicly available TED talks from their website (, 2,224 talks as of today, 2006-2016) and used the summaries and transcripts to feed our robot; a state-of-the art machine-learning AI algorithm.

After the robot gathered all the content—which took only seconds—we asked it key questions. The robot uses a cognitive-pattern detection algorithm across all talks, so it looks for common patterns within the presentations of all speakers. The robot builds patterns and presents its findings about key topic clusters in a colorful knowledge map – TED Talk maps. The size of the cluster represents the number of talks that have been assigned to a given thematic cluster. The most important clusters are shown in the center. So behind each cluster is the respective number of TED talks that deal with the cluster name shown.

Our natural language processing “robot” works like a natural human response would have: our brains use cognitive shortcuts to make sense of our increasingly complicated world, and the shortcuts used here by our machine learning algorithm seem to have the same effect. Out of these 520 hours of video, the robot was able to extract the important shortcuts with cognitive text processing.

Please visit and read the full article on LinkedIn here:

Download the spreadsheet with all details here: