Learning 3-term DNFs

cosmos 6th March 2017 at 12:23pm

See Probably approximately correct

T1T2T3T_1 \vee T_2 \vee T_3 where TiT_i is boolean conjunction

This class is not PAC-learnable, unless RP=NP.

RP is a randomized version of P. Recognize when string is not in language. when it is in language, recognize that it is, with a minimum probability.

Can show this is NP by reduction to graph-colouring.

See photos: we can prove that if the graph has a three colouring, then given the way we constructs the samples SS, there is a 3-term DNF which satisfies all the examples.

We can also show the reverse.

Then finding the best 3-term DNF from the examples (learning) is equivalent to finding if there exist a graph colouring, so it is not efficient.