Fix: make sure task can use agent's knowledge (#1870)

Fix: make sure task can use agent's knowledge (#1870) #247