CS156
Chris Pollett
May 2, 2012
We have described several agents so far this semester. The components of these agents which might be improved include:
The book gives examples of the above in terms of a taxi driver agent.
There are three main types of feedback that correspond to the three main types of learning:
In addition, to the above there is also things such as semi-supervised learning where we are given a few labeled examples and must make what we can of a large collection of unlabeled examples.
Given a training set of `N` example input-output pairs
`(x_1, y_1), ..., (x_n, y_n)`,
where each `y_j` was generated by an unknown function `y=f(x)`, discover a function `h` that approximates the true function `f`.
Here is an algorithm for coming up with a decision for a set of examples.
function Decision-Tree-Learning(examples, attributes, parent_examples) returns a tree if examples is empty then return Plurality-Value(parent_examples) else if all examples have the same classification then return the classification else if attributes is empty then return Plurality-Value(examples) else A := argmax_(a in attributes)Importance(a, examples) tree := a new decision tree with root test A for each value v_k of A do exs := {e : e in examples and e.A = v_k} subtree := Decision-Tree-Learning(exs, attributes - A, examples) add a branch to tree with label (A=v_k) and subtree subtree return tree