Actions

Algoliterary Encounters: Difference between revisions

From Algolit

 
(111 intermediate revisions by 4 users not shown)
Line 1: Line 1:
Start of the Algoliterary Encounters catalog.
+
__NOTOC__
 
+
== About ==
==== General Introduction ====
+
* [[An Algoliterary Journey]]
 
+
* [[Program]]
==== Overview of Techniques ====
 
 
 
===== Rule-based agents =====
 
 
 
* [[introduction Rule-Based]]
 
 
 
* [[Oulipo Recipes]]
 
 
 
* [[Textmining is]]
 
 
 
===== Classic Machine Learning =====
 
 
 
* [[introduction Classic Machine Learning]]
 
  
 +
==Algoliterary works==
 +
A selection of works by members of Algolit presented in other contexts before.
 
* [[i-could-have-written-that]]
 
* [[i-could-have-written-that]]
 +
* [[The Weekly Address, A model for a politician]]
 +
* [[In the company of CluebotNG]]
 +
* [[Oulipo recipes]]
  
* [[The Weekly Address]]
+
==Algoliterary explorations==
 +
This chapter presents part of the research of Algolit over the past year.
  
===== Neural Networks =====
+
=== What the Machine Writes: a closer look at the output ===
 +
Two neural networks are presented more closely, what content do they produce?
 +
* [[CHARNN text generator]]
 +
* [[You shall know a word by the company it keeps]]
  
* [[introduction Neural Networks]]
+
=== How the Machine Reads: Dissecting Neural Networks ===
 
+
==== Datasets ====
* [[RCharNN]]
+
Working with Neural Networks includes collecting big amounts of textual data.
 +
We compared a 'regular' size with the collection of words of the Library of St-Gilles.
 +
* [[Many many words]]  
  
==== Elements of Neural Networks ====
+
=====Public datasets=====
 +
Most commonly used public datasets are gathered at [https://aws.amazon.com/public-datasets/ Amazon].
 +
We looked closely at the following two:
 +
* [[Common Crawl]]
 +
* [[WikiHarass]]
  
===== input (datasets) =====  
+
=====Algoliterary datasets=====
 +
Working with literary texts allows for poetic beauty in the reading/writing of the algorithms.
 +
This is a small collection used for experiments.
 +
* [[The data (e)speaks]]
 +
* [[Frankenstein]]
 +
* [[Learning from Deep Learning]]
 +
* [[nearbySaussure]]
 +
* [[astroBlackness]]
  
* posters with literary works that are readable for machines and escape copyright
+
==== From words to numbers ====
 +
As machine learning is based on statistics and math, in order to process text, words need to be transformed to numbers. In the following section we present three technologies to do so.
 +
* [[A Bag of Words]]
 +
* [[A One Hot Vector]]
 +
* [[About Word embeddings|Exploring Multidimensional Landscapes: Word Embeddings]]
 +
* [[Crowd Embeddings|Word Embeddings Casestudy: Crowd embeddings]]
  
* public domain dataset
+
===== Different vizualisations of word embeddings =====
 +
* [[Word embedding Projector]]
 +
* [[The GloVe Reader]]
  
===== text-to-numbers / vectors =====
+
===== Inspecting the technique behind word embeddings =====
 +
* [[word2vec_basic.py]]
 +
* [[Reverse Algebra]]
  
* posters of matrices
+
=== How a Machine Might Speak ===
 
+
If a computer model for language comprehension could speak, what would it say?
* bag-of-words: physical book vector exercise (with multiple books or with one book)
+
* [[We Are A Sentiment Thermometer]]
 
 
* poster word embeddings one-hot-vector script
 
 
 
* annotated word2vec script http://www.algolit.net/scripts/word2vec_annotated/ - Manetta
 
 
 
===== layers, nodes, weights =====
 
 
 
* backpropagation (linear algebra, influence of weight on network)
 
 
 
===== multidimensionality =====
 
 
 
* digital interactive visualisation & printed visualisation 1 poster for 1 dimension (total could be 30 posters)
 
 
 
===== algorithms/nodes =====
 
 
 
* softmax poster/booklet with comments on code & output
 
 
 
* visualisations
 
 
 
* playground.tensorflow.org javascript
 
   
 
===== output =====
 
 
 
==== Datasets ====
 
  
* Context of Neural Networks
+
== Sources ==
 +
The scripts we used and a selection of texts that kept us company.
 +
* [[Algoliterary Toolkit]]
 +
* [[Algoliterary Bibliography]]
  
* Frameworks & Existing Communities
 
  
* Algoliterary Works by Others
+
[[Category:Algoliterary-Encounters]]

Latest revision as of 13:50, 2 November 2017

About

Algoliterary works

A selection of works by members of Algolit presented in other contexts before.

Algoliterary explorations

This chapter presents part of the research of Algolit over the past year.

What the Machine Writes: a closer look at the output

Two neural networks are presented more closely, what content do they produce?

How the Machine Reads: Dissecting Neural Networks

Datasets

Working with Neural Networks includes collecting big amounts of textual data. We compared a 'regular' size with the collection of words of the Library of St-Gilles.

Public datasets

Most commonly used public datasets are gathered at Amazon. We looked closely at the following two:

Algoliterary datasets

Working with literary texts allows for poetic beauty in the reading/writing of the algorithms. This is a small collection used for experiments.

From words to numbers

As machine learning is based on statistics and math, in order to process text, words need to be transformed to numbers. In the following section we present three technologies to do so.

Different vizualisations of word embeddings
Inspecting the technique behind word embeddings

How a Machine Might Speak

If a computer model for language comprehension could speak, what would it say?

Sources

The scripts we used and a selection of texts that kept us company.