Is "of little importance" a grammatically right phrase?
Yes, to be "of little importance" is a commonly used expression to show that something is not very important. Here, the speaker is stating that small talk IS actually important, by using a double negative (not, little). Ex: Who the group leader will be is of little importance. First, we need to decide on our group topic. Ex: The destination is of little importance. What matters is the journey.